Developing a python-based scraper that aims to download 80k firmware images from supported devices manufactured by over 100+ vendors.
Deployed and managed the containerized application on Kubernetes, along with developing a logging service.
Currently contributing to a firmware open source project - FirmAE. Which is a python based web scraper.
Wrote highly maintainable, solid code in Python for data engineering systems using Hadoop and PySpark on AWS Elastic Map Reduce that formed the core ETL framework. Also worked on several data science and ML algorithms to enhance the search system to improve search relavancy.
Contributed to Unbxd search, autosuggest and recommendation UI libraries along with integrating them to e-commerce websites.
Was part of larger team responsible for building a software for automating the work flow of mission critical information which aimed to avoid manual errors.