In this post I’ll demonstrate how to get the ELK Stack up and running. Installing the ELK Stack First we will install Elasticsearch, then Logstash, and then finally Kibana. Most of the instructions are the same if you follow the official documentation (links provided below). If you follow my instructions, you’ll get the parts that…
Criminal Analysis: Data Exploration
Thus far I have gathered and stored my data for the vast majority of the project into my PostgreSQL database. Now its time to explore the data. Over the next series of posts for this project, I plan to share different methods of exploring the data. Initially I’ll demonstrate using R to tap into my…
Derive a Star Schema By Example
This post will describe the implementation of the star schema using the “Crime” table from my Criminal Analysis project. The original table represents criminal incidents in Washington DC from 2009 through 2020 (October). The table also has 23 columns, 7 of which are spatial grouping categories. I’ll demonstrate how to decompose the table of data…
Criminal Analysis: Data Search (part 4)
I have gathered three quarters of my branches on the “Other Data Sources” category. The next up is to get real estate data based on the project plan. Real Estate Data Finding good real estate data took a some work to explore and gather. I’m sure there is a lot of data available privately for…
Data Storage: pgAdmin
pgAdmin is the leading Open Source management tool for Postgres, the world’s most advanced Open Source database. pgAdmin 4 is designed to meet the needs of both novice and experienced Postgres users alike, providing a powerful graphical interface that simplifies the creation, maintenance and use of database objects. https://www.pgadmin.org/docs/pgadmin4/4.28/index.html This post will describe how to…
Data Storage: Installing PostgreSQL and PostGIS
This post will describe how to install both the PostgreSQL database and the PostGIS geodatabase extension. If you have been following my Criminal Analysis: Data Storage posts then this will be a repeat of information. Installing and Setting up PostgreSQL On a Linux machine, getting PostgreSQL installed and running is pretty easy and straight forward….
Criminal Analysis: Data Storage (part 2)
In this post I will go over setting up a geospatial database using PostGIS, an extension to PostgreSQL. For information about setting up a PostgreSQL database please refer back to my previous Data Storage. Below is the project plan to ensure I load up all my downloaded map data. Installing and Setting up First you…
Criminal Analysis: Data Storage
Now that we have collected our data, lets work on building a database to store our project data. For this project I have decided to use a PostgreSQL database. The image below provides some planning details to help us implement the database. Installing and Setting up On a Linux machine, getting PostgreSQL installed and running…
Criminal Analysis: Data Search (part 3)
So far I have gathered half of my other data sources. The next up is to get employment and real estate data based on the project plan. Employment Data I generally searched for “Washington DC” and “employment data” but later modified it a little based on the results I got. https://duckduckgo.com/?t=lm&q=washington+dc+employment+data&ia=web https://duckduckgo.com/?t=lm&q=Washington+DC+unemployment+data+historical+data&ia=web DC Department of…
Criminal Analysis: Data Search (part 2)
Now that we have our crime and mapping data, lets work on gathering the other data I wrote down during the previous Planning post. Part 2 of Data Search will focus on our Other Data Sources branch in the project plan. Moon Phases On previous work projects, I have come across a couple of R…
