Job description
Responsibilities
1The ideal candidate will have a good understanding of big data technologies data engineering and cloud computing DWH Projects with a focus on Azure Databricks
2Work closely with business stakeholders and other IT teams to understand requirements and define the scope for engagement with reasonable timeline
3Ensure proper documentation of architecture processes while ensuring compliance with security and governance standards
4Ensure best practices are followed by team in terms of code quality data security and scalability
5Stay updated with the latest developments in Databricks and associated technologies to drive innovation
6Positive attitude and excellent communication skills to manage customer calls Excellent problemsolving skills Good communication Team collaboration
Essential Skills
Overall 12 years of experience along with 5 years of data Analytics project experience
Experience with Azure Databricks notebook development and Delta Lake
Good understanding of Azure services like Azure Data Lake Azure Synapse and Azure Data Factory Fabric
Experience with ETLELT processes data warehousing and building data lakes
SQL skills and familiarity with NoSQL databases
Experience with CICD pipelines and version control systems like Git
Soft Skills
Excellent communication skills with the ability to explain complex technical concepts to nontechnical stakeholders
Strong problemsolving skills and a proactive approach to identifying and resolving issues
Leadership skills with the ability to manage and mentor a team of data engineers
Nice to have Skills
Power BI for dashboarding and reporting
Microsoft Fabric for analytics and integration tasks
Spark Streaming for processing realtime data streams
Experience
1Over 12 years of IT experience including 4 years specializing in developing data ingestion and transformation pipelines using DatabricksSynapse notebooks and Azure Data Factory
2Good understanding on different domainindustries with respect to data Analytics project DWH projects
3Should be good in Excel and Power Point
4Good understanding and experience with Delta tables Delta Lake and Azure Data Lake Storage Gen2
5Experience in building and optimizing query layers using Databricks SQL
6Familiarity with modern CICD practices especially in the context of Databricks and cloudnative solutions
...world a better place is who we are at State Farm. It is at the core of how we operate and... ...Hybrid PM22 Our Benefits Because work-life balance is a priority at State Farm,... ...working both in the office and from their home. Work arrangements could change over time...
...passionate about making a difference in the lives of families? T hom Child & Family Services located in Norwood , MA i s seeking Registered Nurses to join their team. As an Early Intervention Registered Nurse (RN) you will be responsible for providing home and...
Class A truck driver Jobproduce haulerPay: $1400 per weekhealth dentalHow to apply for this Driving JobFill out a Gary's Job Board application. That same application can be used to apply to as many jobs as you'd like. Create a Driver's Account.Person to Contact...
...About the Role: As a Registered Nurse within the Health Care and Social Assistance industry, you will play a critical role in delivering high-quality patient care across diverse clinical settings. Your primary objective will be to assess, plan, implement, and evaluate...
...82601 Company: PacifiCorp POWER YOUR GREATNESS PacifiCorp is seeking customer-centric candidates to grow and sustain our commitment to a culture of customer service excellence, environmental sustainability and diversity, equity and inclusion Responsibilities...