In this post, I will demonstrate loading my criminal activity data into ElasticSearch sot it can be explored, analyzed and visualized in Kibana. For instructions on installing and configuring the Elastic (formerly ELK) Stack, see my previous post. Although this post will specially reference the crime data from my PostgreSQL database, I will include additional…
Thus far I have gathered and stored my data for the vast majority of the project into my PostgreSQL database. Now its time to explore the data. Over the next series of posts for this project, I plan to share different methods of exploring the data. Initially I’ll demonstrate using R to tap into my…
I have gathered three quarters of my branches on the “Other Data Sources” category. The next up is to get real estate data based on the project plan. Real Estate Data Finding good real estate data took a some work to explore and gather. I’m sure there is a lot of data available privately for…
In this post I will go over setting up a geospatial database using PostGIS, an extension to PostgreSQL. For information about setting up a PostgreSQL database please refer back to my previous Data Storage. Below is the project plan to ensure I load up all my downloaded map data. Installing and Setting up First you…
Now that we have collected our data, lets work on building a database to store our project data. For this project I have decided to use a PostgreSQL database. The image below provides some planning details to help us implement the database. Installing and Setting up On a Linux machine, getting PostgreSQL installed and running…
So far I have gathered half of my other data sources. The next up is to get employment and real estate data based on the project plan. Employment Data I generally searched for “Washington DC” and “employment data” but later modified it a little based on the results I got. https://duckduckgo.com/?t=lm&q=washington+dc+employment+data&ia=web https://duckduckgo.com/?t=lm&q=Washington+DC+unemployment+data+historical+data&ia=web DC Department of…
Now that we have our crime and mapping data, lets work on gathering the other data I wrote down during the previous Planning post. Part 2 of Data Search will focus on our Other Data Sources branch in the project plan. Moon Phases On previous work projects, I have come across a couple of R…
Now that we have our crime data, lets work on gathering the other data I wrote down during the previous Planning post. Part 1 of Data Search will focus on our Map Data branch in the project plan. Map Data Boundary Data Using the same Open Data website, I just queried for DC boundary and…
Searching for Criminal Activity Data My initial search begins with querying for “Washington DC” and “Crime Data”. This is very broad but it lets me see what is available. I can always get more specific. https://duckduckgo.com/?q=Washington+DC+crime+data&t=lm&ia=web My results yielded a couple pages of interest. Check out the sites that seem interesting or could provide the…
UPDATE (12/6/20): I have removed the original content in this post concerning the Data Search work for the crime data. You can now find that portion of the original post here. In this series, I will be exploring the criminal activity in Washington DC over the past decade. I have explored the data in previous…
