User details
AM
AM
Adithya Malaraju
@adithya_malaraju_y5olzdqx9
Data Engineer
Minneapolis, MN, United States
1Follower0Following0Mutual0Post
Member since: Jan 20, 2025● Led the migration of on-prem data warehouse to Azure Synapse using Polybase and ADF, ensuring a smooth transition with minimal downtime and maintained 99.9% data integrity throughout the process.
● Architected ETL workflows with Azure Data Factory and Databricks to enhance automation and scalability, designing an Operational Data Store (ODS) that improved query performance by 30% and data processing by 25%.
● Collaborated with cross-functional teams, including DBAs and support staff, to streamline and production code deployment, reducing deployment time by 40% and minimizing manual intervention by 60%.
● Pioneered and deployed SQL queries and SSIS packages to create data pipeline jobs, optimizing T-SQL scripts—views, stored procedures, triggers, and user-defined functions to improve data efficiency by 35% and reduce manual tasks by 50%.
● Developed and optimized stored procedures, functions, and SQL queries in Snowflake, enabling the end-to-end development and deployment of 3+ data marts for dashboard applications.
● Integrated extensive datasets for a customized Data Lake in S3, optimizing data warehouse solutions to meet business objectives by reducing data retrieval time by 20%.
● Spearheaded a notification system for Slack that processed change data capture events from over 300 tables, utilizing AWS Lambda and SQS while reducing data delays by 20%
● Implemented Agile practices by overseeing 200+ code reviews, delivering 300+ changes, and driving operational improvements through the debugging of 200+ issues, including service disruptions and in-depth root cause analysis.
● Conducted data analysis and Yielded insights using Hive on HDFS, supporting data visualization and business intelligence for over 15 projects, Achieving a 25% improvement in decision-making speed and enhancing advanced analytics capabilities for effective risk management.
● Experienced in developing and deploying over 50 Docker containers with Kubernetes for DevOps applications across multiple namespaces, resulting in a 30% increase in deployment efficiency and a 25% reduction in resource consumption.
● Authored ETL pipelines using Azure Data Factory to meet business-specific data ingestion and transformation needs, resulting in a 50% reduction in processing time and a 20% increase in data accuracy for reporting.
● Constructed real-time streaming data models leveraging Azure Event Hubs and Databricks to integrate data from Kafka, enhancing data accessibility and decision-making speed for business intelligence applications, Effectuating a 40% increase in actionable insights for stakeholders.
● Generated DDL scripts for over 300 tables, reducing migration time by 50% and minimizing manual errors by 70%.
● Built 6+ interactive dashboards using Power BI to streamline data visualization processes and enhance decision-making, while controlling and automating workflows with Apache Airflow and Logic Apps, resulting in a 50% reduction in processing time for data pipelines.
● Led 50+ successful releases, conducting knowledge transfer sessions that upskilled over 20 team members and reduced onboarding time by 30%, ultimately enhancing team productivity and collaboration.