Data Engineer - SQL/Python

Job Description : - Hands-on experience on AWS and Databricks Must have hands-on proficiency in Python, SQL, Shell script SparkSQL, NoSQL, PySpark is a plus. - Advanced development expertise in Python 3.x, including the ability to develop back-end components. - Proven development experience of RESTful APIs and/or full-stack applications using a Python web framework such as Django, Flask, etc. - Data migration experience from on prem to cloud is a plus Knowledge of AWS/Azure DevOps processes like Cl/CD as well as Agile tools and processes including Git, Jenkins, Jim, and Confluence - Strong programming skills (ability to create efficient algorithms and data structures) - Experience in cloud and container-based deployments, using AWS, Kubernetes etc. is a plus Good knowledge of integrating, analyzing, and presenting relevant metrics for very large data sets - Good to have programming language experience with .NET or Spark/Scala Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQL/PySpark - Working experience with Visual Studio, PowerShell Scripting, and ARM templates. - Understanding of Data Modeling and defining conceptual logical and physical data models. - Big Data/analytics/information analysis/database management in the cloud - loT/event-driven/microservices in the cloud- Experience with private and public cloud architectures, pros/cons, and migration considerations. (ref:hirist.tech)

Location: Chennai, IN

Posted Date: 4/24/2024