Web scraping is the practice of harvesting large amounts of data from the internet and storing it locally or in a database to be processed, for example, pulling many scientific journals and processing the results.
Theory Jar, September 01, 2017
![image of category](/static/d3305031604dda163eb2547879b15abf/f928f/theoryjar_prototype.png)
The aim of Theory Jar was to translate scientific jargon into lay language. I was responsible for scraping text to build a corpora, and processed this using Python's Natural Language Toolkit (NLTK). With this accomplished, a mySQL database was connected to a web application that could accept any…
Tuberculosis Sample Study, November 23, 2016
![image of category](/static/671cf63468f185ad3d6ef70d661b627c/a96bd/TB_Wordcloud.png)
28,000 tuberculosis (TB) sample entries were extracted from the NCBI Database in order to better understand the wide array of descriptors entered at the time these samples were uploaded. A custom frequency-based word cloud was created from all 322 descriptors to highlight the difficulty in…