Author Archives: Brennan

Recently, I was asked to complete a linear regression task. I was given two .csv files, merged the two files, and cleaned up the data points using pandas. The dataset has the following information: 1) the country 2)the year 3)the dependent variable provided to me is in percent format, representing the percent of total GDPContinue reading “Linear Regression with Percentages”

Scraping linked in profile and automated personalized connections. Previously, I posted about using Selenium’s WebDriver to automate the sign in process, scrape user profile headers, job experience, and education history. Once this information has been obtained, it can be used to create a ‘personalized’ message, and Selenium enables you to automate the entire process. IContinue reading “Web Scraping #5”

Continuing the long road that is scraping LinkedIn profiles with Selenium LinkedIn contains a wealth of information for a large community of working (or looking for work) professionals. Up until this point, I have gone through the process of automating the sign in process, scraping search results, and the basic process that starts off theContinue reading “Web Scraping #4”

Scraping individual Linkedin profiles for information. Previously, I went through the process of automating your Linkedin login, and scraping potential connections after automating the search from the homepage post sign in. I will start by creating the Selenium WebDriver instance, calling it ‘driver’. Then I will log into my linked in account using the processContinue reading “Web Scraping #3”

Using Selenium for web scraping jobs, connections, etc. Back in Web Scraping #1, I walked through how to automate the login process for LinkedIn. So, now that we are logged in, the fun begins with Selenium. I am going to walk through searching LinkedIn and scraping the search results page. This process picks up immediatelyContinue reading “Web scraping #2”

Automate Your LogIn with Selenium Web scraping is a great way of obtaining data, but with all of the data available, doing it efficiently is another story. I am starting my web scraping journey by using LinkedIn’s search function to find connections, as I am a relatively new professional in the field of data science,Continue reading “Web Scraping #1”

There are various ways to display data, but there are a few things to consider before creating a graph to convey to that data to someone else. Whether it is numerical or categorical, a means to convey the composition of your data is a common necessity. An initial basic composition assessment is a good placeContinue reading “Data Visualizations”

Eighty to ninety percent of a data science project involves processing the data, this has to happen before any model is fit. Data comes in a variety of disarray, different file formats, empty values, even no formatting. Once you sift through the data, organize it, standardize it, and really start to visualize the data, featureContinue reading “Feature Selection”

The violin plot is, in my opinion, very underrated. Everyone knows the box plot ( or the box and whisker plot), but the violin plot can do everything a box plot can do, with more style. It’s a great way to visualize density representation, the wider parts of the violin body show a higher density.Continue reading “Violin>Box”

Audio analysis in machine learning can be done using complete audio timelines or extracting information from certain features. Depending on the end goal, there are a multitude of methods one can use to analyze audio. Common applications for machine learning in audio classification include speech recognition, music tagging, and fingerprinting. My capstone project was doneContinue reading “Audio & Machine Learning”