Lahore, Pakistan
I'm a Data Engineer at Datalytics24 and my responsibilities are:
-> Web Scraping, Crawling, Data parsing or other data mining
-> Work with Real-time Monitor
-> Fetch data from multiple online sources
-> Processing, cleansing, and verifying the data used for analysis
-> Work closely with Databases in SQL, PostgresSQL and NoSQL databases (Elasticsearch)
-> Develop Scrapers, Crawlers and model integration
-> Rest API's in Django Framework
-> Testing such structures to ensure that they are fit for use
English, Urdu
scrapy selenium BeautifulSoup requests pandas threading
I have more than 4 years of experience in Python Django web development, writing python scripts for web scraping and other scripting utilities. I am a professional in this field. I can make any kind of website in Python Django, scrape data from any type of web and I can write any kind of automation scripting utilities too. Following is the list of few frameworks/expertise:
1) Python
2) Django
3) Data mining and crawling
4) Monitoring websites for product notifications.
4) Web Scraping using Scrapy or Beautiful Soap
5) Fetching data from the backend API
6) Django rest framework
7) Full stack development
I also have been doing freelancing.Below are my profile links attached.
Big Data, Data Science, Django, Django REST Framework, Linux, MySQL, PostgreSQL, SQL, Scrapy, Web Scraping, wxPython