User details
AB
AB
Abhishek Bhaumik
@abhishek_bhaumik_06jkv0lpr
Python Developer
Elkins Park, PA, United States
1Follower1Following0Mutual0Post
Member since: Feb 05, 2025. AWS Certified Solution Architect with 12+ years of experience in Analysis, Design, Development, Testing, Customization, Enhancement, Support, and Implementation of web, stand-alone, and enterprise applications using Python (Django, Flask, FastAPI), MySQL, PostgreSQL, NoSQL (MongoDB, Apache Cassandra, Accumulo), AWS, Kubernetes, and DevOps. . Proficient in Python, Django, Flask, FastAPI, with frontend expertise in JavaScript, TypeScript, Angular, React, jQuery, Bootstrap, Tailwind CSS. Experience in component-based UI development, state management (Redux, Context API), and performance optimization. . Deep understanding of MySQL, PostgreSQL, and NoSQL (MongoDB, Cassandra, Redis, Firebase, OrientDB). Skilled in SQL queries, stored procedures, triggers, joins, subqueries, indexing, query optimization, and high-performance database design for large-scale applications. Extensive experience with AWS (Lambda, EC2, S3, RDS, CloudFormation, API Gateway, IAM, Data Pipeline), Docker, Kubernetes, Terraform, Jenkins, CI/CD, GitHub Actions, Nexus, CHEF, Ansible.
• Expertise in infrastructure as code (laC), container orchestration, and cloud cost optimization. . Hands-on expertise in Hadoop ecosystem, Spark, Scala, HBase, Hive, Cloudera, Elasticsearch, and data pipeline orchestration. . Experience in ETL processes, real-time data streaming, and distributed computing architectures. Skilled in Regression Models, Time Series, Clustering, Principal Component Analysis (PCA), TensorFlow, PyTorch, OpenCV, SciPy, NumPy, Pandas, Scikit-learn, Matplotlib, Seaborn. . Experience in model deployment, hyperparameter tuning, and MLOps for scalable Al solutions. . Strong experience in RESTful APIs, SOAP, GraphQL, OpenAPI, Swagger, Postman, OAuth 2.0, JWT, WebSockets, and API security best practices. Expertise in asynchronous programming, serverless architectures, and API gateway integrations.
• Proficient in Python, Bash, PowerShell, automating CI/CD pipelines and cloud infrastructure as code. Hands- on experience with cron jobs, log monitoring, and process automation to improve efficiency and scalability. . Knowledge of network protocols, authentication mechanisms, security standards (SAML, OAuth, SSL/TLS), OWASP security best practices, firewall configurations, and access control mechanisms. . Experience in security hardening, penetration testing, and DevSecOps.
• Expertise in Agile (Scrum, Kanban), SDLC, TDD, BDD, with experience collaborating across cross-functional global teams. Familiar with CI/CD best practices, automated testing frameworks, and deployment strategies.
• Strong analytical and debugging skills, with hands-on experience in modular system design, scalable architecture, and event-driven development. Expertise in design patterns, SOLID principles, and performance optimization techniques. . Effective in stakeholder communication, working with cross-functional teams, and translating technical concepts for non-technical audiences.
• Experience mentoring developers, conducting code reviews, and leading technical discussions.
• Experience leading enterprise IT system integrations, driving automation, and ensuring scalable, high- availability implementations. . Hands-on experience in cloud migration, hybrid cloud strategies, and digital transformation projects.
• Proven ability to optimize application performance, reduce latency, and scale distributed systems. . Experience in caching strategies (Redis, Memcached), load balancing, and horizontal scaling.
• Passionate about emerging technologies, Al-driven solutions, and improving system efficiency. Always exploring cutting-edge tools, frameworks, and best practices to drive technological advancements.
• Develop scalable data pipelines using Apache Airflow and PySpark to process and transform large-scale energy consumption datasets for PGE. . Design and implement ETL workflows in AWS Glue, integrating structured and unstructured data from multiple sources (smart meters, loT sensors, customer billing data, power grid logs) into AWS S3, Amazon Redshift, Snowflake, and MongoDB. . Utilize Apache Kafka for real-time energy consumption data ingestion and batch processing frameworks to load data into HDFS and migrate it back to AWS S3.
• Leverage Databricks (Spark on AWS) for distributed data processing, performing data transformation, cleansing, and enrichment for power grid analytics. . Incorporate MongoDB as a NoSQL database for storing unstructured and semi-structured energy data, such as sensor logs, customer interactions, and LLM-generated insights.
• Optimize SQL queries and implement indexing techniques to improve performance on Amazon Redshift, Snowflake, and Amazon RDS.
• Deploy Large Language Models (LLMs) to automate customer support responses, analyze energy consumption patterns, and predict outages. Train LLMs using PyTorch & Hugging Face on historical power grid failures to enhance predictive maintenance.
• Integrate LLMs with FastAPI & Flask-based microservices, enabling real-time customer Q&A via a chatbot for PGE's self-service portal. . Develop and maintain RESTful and GraphQL APIs using FastAPI, Django, and Flask, ensuring seamless data integration between the energy grid, billing systems, and customer web apps. . Implement JWT-based authentication and Role-Based Access Control (RBAC) using FastAPI's dependency injection model. Secure React front-end authentication with OAuth2, JWT, and secure cookie-based authentication. Use Django ORM and SQLAlchemy for efficient data management across PostgreSQL, MongoDB, Amazon Redshift, and Snowflake. . Build FastAPI & Flask microservices for real-time energy consumption tracking, Kafka-based event-driven processing, and serverless execution (AWS Lambda). . Develop React.js-based dashboards for real-time energy consumption tracking, predictive grid analysis, and customer billing insights. Utilize React Hooks (useState, useEffect, useContext), React Router, Redux, and Context API for state management. Optimize front-end performance using lazy loading, code splitting, and dynamic imports. . Automate AWS infrastructure provisioning using Terraform, setting up Amazon EC2, VPCs, S3, RDS, IAM, AWS Lambda, and Amazon CloudFront. . Optimize AWS Elastic Load Balancer (ELB) and Auto Scaling Groups (ASG) for high availability and fault tolerance.
• Implement CI/CD pipelines using GitHub Actions, AWS CodePipeline, and Jenkins, automating deployments for both the front end and backend. . Utilize Docker containers for microservices architecture, orchestrating deployments with Amazon ECS and Amazon EKS. .
• Developed scalable data pipelines using Python, PySpark, AWS Glue, processing terabytes of structured/unstructured data. Optimized Apache Spark transformations (partitioning, caching, broadcasting, UDFs). . Designed cloud-native AWS infrastructure with EC2 Auto Scaling, VPC peering, Route 53, ALB/NLB. Configured IAM policies & security groups.
• Implemented authentication & authorization with OAuth2, JWT, AWS Cognito, enabling RBAC & MFA.
. Built RESTful APIs & microservices with Flask/Django, optimizing SQLAlchemy ORM performance (indexing, pooling, replicas).
. Orchestrated ETL workflows with Apache Airflow, integrating Databricks & Delta Lake for efficient storage/querying.
Deployed APIs using Gunicorn & Nginx on AWS ECS (Fargate) & Kubernetes (EKS) with auto-scaling & load balancing.
. Integrated SQL & NoSQL databases (PostgreSQL, MySQL, DynamoDB, AWS RDS), enforcing data integrity via SQLAlchemy.
• Designed API documentation with Swagger (OpenAPI), ensuring standardization & HIPAA compliance for secure data transmission.
• Optimized API integrations with Axios & Redux Toolkit, reducing redundant API calls & improving caching.
• Developed high-performance UI components with React.js, Material-UI, Tailwind CSS, Styled Components.
. Built data visualization dashboards using Tableau, Power BI, Matplotlib, Plotly for real-time insights.
. Automated CI/CD pipelines with Jenkins, GitHub Actions, Docker, Kubernetes, AWS CodeDeploy, AWS Code Pipeline.
• Implemented real-time event streaming with Apache Kafka & AWS SNS/SQS, enabling event-driven architectures.
• Optimized API performance using Redis caching, AWS ALB/NLB load balancing & rate limiting for high traffic.
. Secured ML services with OAuth2, JWT, IAM policies, HIPAA-compliant encryption & drift detection monitoring.
. Collaborated with ML engineers to optimize data preprocessing & feature engineering for scalable training.
Environment: Python, Django, Flask, SQLAlchemy, React.js, Redux Toolkit, AWS (Lambda, API Gateway, S3, ECS [Fargate], EKS, DynamoDB, RDS [PostgreSQL, MySQL], CloudFront, SNS, SQS, IAM, VPC, Route 53, Auto Scaling, ALB, NLB), Terraform, PySpark, Apache Airflow, Databricks (Delta Lake), Apache Kafka, Jenkins, GitHub Actions, Docker, Kubernetes (EKS with EC2), ELK Stack (Elasticsearch, Logstash, Kibana), Prometheus, Grafana, Tableau, Power BI, JIRA, Agile (Scrum/Kanban).
• Developed scalable backend services and RESTful APIs using Python (Django, Flask) and Django REST Framework (DRF), following MVC architecture. Built dynamic UI components with Angular 6/7, TypeScript, JavaScript, HTML, CSS, and Bootstrap, ensuring seamless frontend-backend integration. . . Optimized database transactions using Django ORM, SQLAlchemy, PostgreSQL, MySQL, implementing query indexing, partitioning, and stored procedures. Automated AWS infrastructure provisioning using AWS CloudFormation & Ansible, managing EC2, RDS, S3, IAM, API Gateway, and CloudWatch.
•
◦ Implemented CI/CD pipelines with Jenkins, Bitbucket Pipelines, and AWS CodePipeline, ensuring smooth deployments. . Enhanced API security using OAuth 2.0, JWT authentication, and RBAC (Role-Based Access Control). Developed asynchronous task processing using Celery and RabbitMQ, improving system scalability and background job execution. . . Integrated monitoring and logging solutions using AWS CloudWatch, ELK Stack (Elasticsearch, Logstash, Kibana) for system observability. Developed unit and integration tests using PyTest, Unittest, and Selenium, ensuring robust application performance.
•
◦ Followed Agile/Scrum methodologies using JIRA, participating in sprint planning, daily stand-ups, and retrospectives. Conducted code reviews and mentored junior developers, promoting best practices and knowledge sharing. Python (Django, Flask), SQLAlchemy, Angular 6/7, TypeScript, Bootstrap, (EC2, RDS, API Gateway, CloudWatch), AWS CloudFormation, Ansible, PostgreSQL, MySQL, MongoDB, Jenkins, Bitbucket Pipelines, AWS CodePipeline, Celery, RabbitMQ, OAuth JWT, ELK Stack
• Automated system administration tasks by developing PowerShell scripts for auditing and compliance enforcement across Windows and Linux (RHEL/CentOS) servers. Developed full-stack applications using Python (Django, Flask), Angular, and JavaScript (ES6+), delivering enterprise automation tools for IT infrastructure teams.
• Designed and deployed RESTful APIs using Django REST Framework (DRF) and Flask, enabling seamless backend communication with Angular-based frontend applications. Optimized database performance for high- traffic applications using PostgreSQL and MySQL, leveraging query indexing, partitioning, stored procedures, and connection pooling.
• Implemented infrastructure as code (laC) using Terraform, provisioning AWS resources such as EC2, RDS, S3, IAM, CloudFront, and API Gateway.
• Led the migration of legacy applications from on-premises data centers to AWS, modernizing services and reducing operational costs by 30%. Developed Ansible playbooks for automating configuration management and patching across hundreds of Linux servers, ensuring security compliance.
Designed security frameworks by integrating OAuth2, JWT, and IAM roles, ensuring secure authentication and role-based access control (RBAC). Containerized monolithic applications into Docker microservices, orchestrating deployments with Kubernetes (EKS) and Docker Swarm for high availability.
• Implemented monitoring and logging solutions using AWS CloudWatch, ELK Stack (Elasticsearch, Logstash, Kibana), and Prometheus, improving system observability.
• Developed automated CI/CD pipelines with Jenkins and Bitbucket Pipelines, integrating Docker, Terraform, and AWS CodePipeline for zero-downtime deployments. Built event-driven workflows using AWS Lambda and SQS, enabling asynchronous processing of large-scale backend jobs.
• Designed ETL data pipelines for processing large datasets, integrating Apache Airflow, AWS Glue, and PySpark to automate data ingestion and transformation.
• Implemented application security best practices, conducting code reviews, vulnerability scanning, and compliance audits to meet regulatory standards.
• Created real-time dashboards with Power BI, Tableau, and Plotly, providing business intelligence insights for network monitoring and infrastructure analytics.
. Led Agile development cycles, collaborating with cross-functional teams using Scrum/Kanban methodologies in JIRA. Provided technical mentorship, training junior developers on Python best practices, database optimization techniques, and DevOps automation. Ansible, (Elasticsearch, RabbitMQ, PySpark, Glue, Grafana, JIRA, Agile (Scrum/Kanban).
• Developed and maintained web applications using Python and Django, implementing RESTful APIs with class- based views for seamless backend communication. Built interactive user interfaces with Bootstrap, HTML, CSS, Javascript, and jQuery, enhancing web application responsiveness. Optimized database performance by migrating from SQLite to MySQL, ensuring data integrity and efficient transactions.
• Designed and implemented XML Schema for structured data exchange, integrating SOAP-based web services for interoperability. Performed unit testing using Python's Unittest framework and Django's native test utilities, ensuring high software reliability.
• Managed large datasets using Pandas and MySQL, optimizing data processing and reporting workflows. Automated build and deployment processes with Bash scripting and Git, ensuring continuous integration. Led system analysis, requirement gathering, and development for multiple projects, collaborating with cross- functional teams.
. Automated application testing using Python, SQL, and Shell Scripts, reducing testing time from 60-90 minutes to 10-15 minutes while improving efficiency. Developed dynamic web applications with Python (Django), HTML, CSS, Javascript, and jQuery, integrating pagination, sorting, and RESTful API interactions (JSON, XML). Optimized UI performance and web tracking by implementing responsive design, event tracking (JavaScript), and Python-based scheduling systems, enhancing user experience.