Awaish Kumar

Senior Software Developer

KARACHI, Pakistan

Summary

Skilled in Python, C/C++, Bash
1. Working in a (web scraping/ ETL) also performing data analysis using jupyter notebook.
2. Management of whole scraping project (from scraping to maintenance, proxy rotation, user agents and cookie management)
2. Have experience of working remotely and in a office setup.
3. Machine learning and NLP Experience

Languages:

Chinese, English, German, Sindhi, Urdu

Favorite Python Packages:

Pandas, Scrapy, requests, metaplotlib, urllib3, w3lib, scipy, numpy scapy, grequests, requests-future

Experience

Senior Software Developer (Working Remotely) January 2019– Present

Danamica ApS Denmark

  • Managing whole scraping system and responsible for continue improving workflow

○ writing new python scripts for web

○ writing new python scripts for scraping mobile apps

○ maintaining currently running scrapers (for continue getting quality data)

○ building middlewares

○ proxy management (to fully and accurately utilize proxies)

  • Building Database (postgres)

○ decide and create new tables schema

○ loading data scraped by scrapers

  • Cleansing of data

○ writing queries to clean data in tables after storage

○ Python scripts for cleansing

  • Analysis

○ analysis using jupyter notebooks

○ listings availability in country/city

○ property type of listing

○ available for booking or not

○ pricing comparisons


Software Engineer July 2017– December 2018

Arbisoft Private Limited Lahore, Pakistan

  • I was involved in the extraction and transformation of data from various sources. So basically I built the

spiders to scrape data (web scraping/crawling) from different websites and API's and then perform cleansing

techniques.

  • I also worked on building the web platform to manage currently build/broken crawlers and also involved in

optimizing current workflow.

  • I was managing a team of 5 people and also performed code reviews.


Teaching Assistant January 2015 – December 2016

National University Of Computer And Emerging Sciences , Pakistan

Responsible for grading of quizzes and assignments, provide hours to help students better understand the concepts. In

Addition I also deliver tutorials on teacher advise. I was TA for below mentioned courses.

● Data Structure

● Computer Organization and Assembly Language

● Basic Electronics

Skills

Backend Development, Data Science, Django REST Framework, Git, Machine Learning, Natural Language Processing, Pandas, PostgreSQL, SQLAlchemy, Scrapy, Virtualenv, Web Scraping

Joined: September 2019