This post will cover benchmarking in Julia using a specific case to evaluate the functions in CSV and CSVFiles packages to write a CSV file. Packages and Versioning In this use case, I am using Julia v1.5.3 with the following packages: Please reference each packages documentation for more details. CSV, CSVFiles, DataFrames, BenchmarkTools. Setting up…
Category: analysis
Benchmarking CSV vs CSVFiles packages: Read
This post will cover benchmarking in Julia using a specific case to evaluate the functions in CSV and CSVFiles packages to read a CSV file. Packages and Versioning In this use case, I am using Julia v1.5.3 with the following packages: Please reference each packages documentation for more details. CSV, CSVFiles, DataFrames, BenchmarkTools. Setting up…
Criminal Analysis: Data Exploration (part 2b)
Exploring Mapping Data In a continuation from part 2a, this post will explore the spatial points datasets from my database. I need to assess what each dataset contains. To aid in the exploration of spatial data, I will demonstrate plotting spatial points. This can be a lot easier to look at this particular structure in…
Criminal Analysis: Data Exploration (part 2a)
Exploring Mapping Data My next exploration task is the mapping/geospatial tables in my database. I need to assess the what each dataset contains. To aid in the exploration of spatial data, I will demonstrate plotting of spatial points and polygons. This can be a lot easier to looking at this particular structure in tabular or…
Criminal Analysis: Data Exploration (part 1)
Exploring Criminal Activity Data My primary data set to explore is the crime table in my database. I need to assess the values and consistency across each of the fields available in what was provided by the source. It is possible for data to be a little inconsistent across each of the years over the…
Criminal Analysis: Data Exploration
Thus far I have gathered and stored my data for the vast majority of the project into my PostgreSQL database. Now its time to explore the data. Over the next series of posts for this project, I plan to share different methods of exploring the data. Initially I’ll demonstrate using R to tap into my…
Criminal Analysis: Data Search (part 4)
I have gathered three quarters of my branches on the “Other Data Sources” category. The next up is to get real estate data based on the project plan. Real Estate Data Finding good real estate data took a some work to explore and gather. I’m sure there is a lot of data available privately for…
Criminal Analysis: Data Search (part 3)
So far I have gathered half of my other data sources. The next up is to get employment and real estate data based on the project plan. Employment Data I generally searched for “Washington DC” and “employment data” but later modified it a little based on the results I got. https://duckduckgo.com/?t=lm&q=washington+dc+employment+data&ia=web https://duckduckgo.com/?t=lm&q=Washington+DC+unemployment+data+historical+data&ia=web DC Department of…
Criminal Analysis: Data Search (part 2)
Now that we have our crime and mapping data, lets work on gathering the other data I wrote down during the previous Planning post. Part 2 of Data Search will focus on our Other Data Sources branch in the project plan. Moon Phases On previous work projects, I have come across a couple of R…
Criminal Analysis: Data Search (part 1)
Now that we have our crime data, lets work on gathering the other data I wrote down during the previous Planning post. Part 1 of Data Search will focus on our Map Data branch in the project plan. Map Data Boundary Data Using the same Open Data website, I just queried for DC boundary and…