Data Engineer - Azure/Databricks

Must-Have : - 4 years of experience in Data Engineering experience on Azure and Databricks - Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required - Experience Developing and tuning Spark Application and SparkSQL queries- - Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform and can build data analytics solutions to support the required performance & scale - Expertise in Data pipeline, scheduling and maintenance - Understanding of Databricks Unity Catalog and Security Practices - Should be proficient in SQL and know about NoSQL databases - Good understanding on Delta file format, how to work with it using Apache Spark and the benefits it provides to ETL workloads - Knowledge in business intelligence tools such as Power BI, Tableau - Experience building and maintaining cloud native services with Azure Dashboarding, Visualization (Tableau/Power BI) - Strong Analytical skills working with a large store of Databases and Tables - Knowledge working with PagerDuty for alerting - Experience working directly with a customer to identify problems and solve problems - Excellent Problem Solving Skills - Excellent Communication Skills - Ready to work in rotational shifts. Role & Responsibilities : - Manage and Maintain Modern Data Pipelines and Data Streams - Maintain data presentation through data visualization tools (PowerBI/Tableau) - File Monitoring and Processing Support - System Level Reports Coordination with the Code deployment team and support - Maintain Runbooks and other supporting documentation for workloads - Batch/Report Execution support - Analyze existing business processes and look for ways to improve through Databricks services - Interact with stakeholders and leaders to understand business goals and data requirements Education : Bachelors or Masters (preferably BE/B.Tech) - Computer Science/IT (ref:hirist.tech)

Location: India, IN

Posted Date: 4/24/2024