/Recent content on Shan IslamHugo -- gohugo.ioenThis work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.Thu, 19 Nov 2020 00:00:00 +0000/projects/Thu, 19 Nov 2020 00:00:00 +0000/projects/This is a list of my own personal projects Web Scraping PS5 Web Scraper which is written in typescript and deployed on Google Cloud Function. This was a project I created to find stock of PS5 on certain websites and send email notifications if it ever found any./haskell/Tue, 21 Apr 2020 22:24:44 +0100/haskell/Structure of a main script with let and do syntax. Save in a script e.g. example.hs 1 2 3 4 5 6 7 8 9 main :: IO () main = do let printString = "Hi" number = 3 putStrLn printString (putStrLn . show) number To compile and run we use stack exec -- runghc example.hs/scala/Tue, 21 Apr 2020 22:24:05 +0100/scala/Table of Contents Useful File exists 1 new java.io.File(file_path).isFile Split List given seperator 1 2 3 4 5 6 7 8 9 10 11 12 import scala.collection.mutable.ListBuffer def listSplit[T](collection:Seq[T],seperator:T):Seq[Seq[T]]= { val name = ListBuffer(ListBuffer[T]()) collection foreach {e => if(e == seperator){ name += ListBuffer[T]() } else { name.last += e } } name.map(_.toSeq).toSeq }/docker/Tue, 21 Apr 2020 21:56:27 +0100/docker/Table of Contents Commands Start a shell prompt Breakdown of docker image Execute Python commands in container Docker Images python3, java8 and Haskell Commands Start a shell prompt To start a shell script inside a running container docker exec -it <container_name> bash To start a shell script inside an image docker run -it --entrypoint /bin/bash <image> Breakdown of docker image Will show a breakdown of layers of docker image/2019-10-17-perfection-is-the-enemy-of-good/Thu, 17 Oct 2019 00:00:00 +0000/2019-10-17-perfection-is-the-enemy-of-good/I heard this phrase once a few years ago in a job interview and it’s stuck with me ever since. The idea is that you don’t need to strive for perfection and that creating something good is….good enough. This resonated with me for a while, I believe in most aspects of my life I strived for perfection most likely Everything was either wrong or right, complete or incomplete there was no middle ground./python/Tue, 18 Dec 2018 15:36:35 +0000/python/Table of Contents Table of Contents Pandas Pandas Conditonal Column Applying functions to Pandas columns Converting strings to date or datetime Pandas Pandas Conditonal Column A conditional column is a column in a dataframe that is generated based on other column/s. There are multiple way of doing this in Python but one of the quickest ways is to use the np.where() function. This function is basically the equivalent of an if statement in Excel./2018-12-15-i-m-now-a-data-scientist/Mon, 17 Dec 2018 00:00:00 +0000/2018-12-15-i-m-now-a-data-scientist/TLDR; I went to a recruitment hackathon 6 months ago and got offered a job. Now part of one of the coolest data science teams around As the title explains, I started a new job two months ago as a junior data scientist! I spoke to a friend of mine when I got the job and he said I should write a blog post on it, so here it is./2017-03-09-sql-part-2-of-4/Fri, 09 Mar 2018 00:00:00 +0000/2017-03-09-sql-part-2-of-4/I said I’d continue these posts this year and that’s what I plan to do! A sequel to my post on SQL! (My wife thought this was a terrible joke) Now let’s talk about SEGMENTATION! Segmentation isn’t something I found as intuitive as basic SQL. You can generally figure out what a basic SQL statement is going to do before it runs. Have a look at my last SQL post for an example./2018-01-23-new-year-new-post/Tue, 23 Jan 2018 00:00:00 +0000/2018-01-23-new-year-new-post/We’re three weeks into January so guess it’s unusual to write a new year post so late into the month. However, I recently had a twitter conversation with John Mackintosh who is a data analyst for the NHS up in Scotland. If you look at his blog site you can see that I based my blog style on his. Long story short, John encouraged me to write more so that’s what I plan to do/2017-10-23-g1-climax/Mon, 23 Oct 2017 00:00:00 +0000/2017-10-23-g1-climax/Here’s a post that is slightly different to the other posts that I’ve done so far. Rather than having a step by step tutorial on how to do something. The below allows me to work on my python skills and explain a few things as I go along. People who work in Data Science tend to work in programming languages R or Python. I’ve been learning both languages over the last two years and at the moment I’m trying to get better at my Python./2017-06-03-pip-install-guide-mini-post/Sat, 03 Jun 2017 00:00:00 +0000/2017-06-03-pip-install-guide-mini-post/I will get back to the SQL posts but thought I would post something that could be useful to others. If you want to use Python for Data Science you will need additional python libraries. I don’t have a huge understanding of command line functions and I found it a bit difficult to find a step by step guide on how to install python libraries . My wife(the doctor) thought that PIP was something else medical related from a scandal a few years ago./2017-05-15-sql-part-1-of-4/Mon, 15 May 2017 00:00:00 +0000/2017-05-15-sql-part-1-of-4/I had to recall what SQL(Structured Query Language) actually stood for because no one actually calls it ‘Structured Query Language’. People just refer to it as ‘see-kwel’ or as my wife calls it a sequel to a movie and that Godfather 2 is the only acceptable kind. If you have a lot of historic data that you need to access and interrogate regularly then SQL is probably the way to go./2017-04-06-first-post/Thu, 06 Apr 2017 00:00:00 +0000/2017-04-06-first-post/You start a blog and then you can’t decide what to write about in your first post. After mulling it over I decided I would write why I want to be a data scientist and show any cool things I’ve seen. If you don’t want to read all the below just skip to the bottom that summarises everything and a cool example of data science in action. I first discovered data science accidently while perusing courses on Udemy when I was looking for courses to improve my SQL skills./about/Mon, 01 Jan 0001 00:00:00 +0000/about/Hi my name is Shan. I’m currently a data analyst scientist based in London, with a background in mathematics and some programming I did in school. I discovered data science over 2 years ago and realised it was my dream job. So I talked it over with my wife and decided to start this blog to hold myself accountable and post my thoughts/tutorials or anything cool I come across the web.