User details
PI
PI
Pujitha Indukuri
@pujitha_indukuri_r14695354
Data Engineer
Dallas, TX, United States
0Follower0Following0Mutual0Post
Member since: Jan 21, 2025• Analytical and enthusiastic data engineer with over 8 years of experience in the technology industry, specializing in Data Modeling, Data Transformation, Data Visualization, and building Data Pipelines
• Skilled in optimizing ETL pipelines, and automating workflows with tools like Databricks and Azure Data Factory with proficient knowledge in Python and SQL
. Accustomed to working closely with data scientists and stakeholders to understand business needs and develop comprehensive data models
• Extensive experience in Snowflake architecture, design, implementation, and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse
• Strong proficiency in handing real time data streaming using Apache Kafka and data visualization tools such as Power BI and Tableau.
• Skilled in handling large Datasets using Python, automating ETL, and extracting data from RESTful API, Azure Storage, FTP servers
• Skilled in designing and managing large-scale data warehouses using Azure Synapse Analytics, optimizing ETL pipelines, and automating workflows with tools like Azure Data Factory, Informatica and Apache Airflow
• A collaborative team player experienced in Agile and Waterfall methodologies, with hands-on experience in multiple programming languages and version control systems
JLL is a Dallas based real estate and investment management firm, offering a wide range of services across commercial real estate, facilities management, and investment advisory.
• Developed and optimized scalable ETL workflows leveraging Databricks, Python, Apache Spark, and Azure Synapse, enabling efficient data processing, integrating large real estate datasets
• Designed and optimized scalable Azure Data Factory pipelines to process sales invoice datasets from Azure Data Lake and REST APIs
• Leverage SQL Pools and Spark Pools in Azure Synapse to efficiently manage and process large-scale datasets from ADLS that improved data processing efficiency by 30%
• Designed, configured, and managed CI/CD pipelines in Azure DevOps to streamline ETL processes and data Workflows
• Implemented Apache Airflow to orchestrate and automate ETL workflows, ensuring efficient scheduling, monitoring, and error handling for data pipelines across diverse sources
• Deployed the initial Azure components like Azure Virtual Networks, Azure Application Gateway, Azure Storage and Affinity groups
• Collaborate with stakeholders to understand data needs and provide actionable insights
• Expertise working on Fact and Dimensional (Product Information) tables in Oracle and Azure SQL Server and developing PL/SQL scripts based on business requirements
• Designed and maintained complex ETL pipelines using Apache Airflow, leveraging DAG-based orchestration to automate data ingestion, transformation, and error alerting for high-volume, mission-critical workflows.
• Decreased database load by 26% by refactoring data structures and implementing an update on event cache
Data Hubs, ADF, SQL Server, Snowflake, ADLS, DAX, Power Query, Power BI, Spark SQL, Python Pernod Ricard is a French multinational company and one of the largest producers of wine and spirits.
• Developed and maintained full-fledged key digital sales transformation program, DSTAR, to empower sales team with right actionable insights and recommendations that improved sales efficiency by 40%
• Developed Data pipelines using Azure Data Factory to feed different data models/data hubs and ensure pipeline stability
• Responsible for extracting data from multiple sources, transforming it into Azure SQL Server, and ingesting it into Azure Data Lake Storage (ADLS) and Snowflake, providing reliable datasets for data scientists
• Designed and deployed data models to Azure Analysis Services, and integrated with Power BI to deliver interactive dashboards and strategic insights . Created interactive Power BI Dashboards, using Data Analysis Expressions (DAX) for calculations, Power Query, KPIs and reports for Monthly Metric analysis to replace traditional excel
• Utilized Azure Databricks, Python and Spark SQL to develop and optimize scalable data pipelines, enabling efficient data processing and analysis within cloud environments
• Managed and resolved various types of request errors encountered in web environments while monitoring ETL pipelines
• Performed data migrations to the SQL database using Django's migration tool
• Worked in agile environment following incremental and iterative solution delivery
Hadoop, HDFS, Hive, SQL, ETL, AKV, Java, Kafka, Azure, JSON, AVRO, ADP, UNIX, Informatica Inc
• Designed, developed, and managed real-time data streaming platform and consolidated retail purchase invoices and e-commerce sales data from multiple sources into SQL server
• Worked on Hadoop to store retail clickstream data in HDFS, process it using Hive to generate insights about user behavior
• Developed and optimized ETL workflows in Informatica PowerCenter, designing complex mappings and transformations to ensure high data quality, efficient processing, and adherence to business SLAs
• Expertise in handling various data sources like flat files, JSON, YAML, AVRO, CSV, GPG encrypted files and real time data feeds through Kafka
• Supported multiple business partners to build campaigns for email marketing and automate data sends to multiple vendors by orchestrating the data using Informatica
• Worked with multiple vendors to develop various data feeds as per business requests and share data sets in GPG encrypted format on scheduled basis to multiple downstream including data scientists
• Experience in data processing includes collecting, aggregating, and moving data into marketing Data warehouse systems using Oracle Toad and SQL Loader
• Created views along with joints, groups, and aggregations in SQL by merging and/or summarizing data from various sources as required to build Tableau dashboards
• Produced continuous data feed to Kafka platforms by encrypting the Personal Identifiable Information (PII) data using Kafka helper class and Azure Key Vault
• Designed and developed REST APIs to facilitate seamless data communication between the backend systems and the website
• Extensive experience in data engineering, working with large-scale data infrastructures, and optimizing ETL processes
• Developed an ETL system to replace an existing data pipeline built on DTS using Python 2.7 and SQL Server
• Collaborated with stakeholders to enhance website functionality and improve user experience
• DevOps knowledge (Jenkins, Bitbucket, Gitlab, Terraform), Testing Automation
Client - Synchrony Bank project involved developing a mobile banking application that provided customers with insights into their spending on their monthly bills
• Created PLSQL scripts and views for customer promotion alerts data and developed REST APIs to expose data to mobile banking application
• Ensured compliance with data safety standards by encrypting and decrypting Personally
• Identifiable Information (PII) according to European regulations
• Optimized existing long running queries by 70% using Execution Plan in T-SQL
• Developed automation solution using PowerShell scripting for day-to-day operational tasks . Modification of Certs, Password and Storage Accounts on the cloud platform Setting up and administer service accounts
• Worked on Configuration of Internal load balancer, load balanced sets and Azure Traffic manager.
• Configured Azure Active Directory and managed users and groups.