Senior Data Engineer (Azure Databricks / Insurance)
- $130,000 - $150,000
- Grandview, MO
Data Engineering + Top Insurance employer!!
A bit about us:
Our client, a leading insurance company, is looking for a Permanent Senior Data Engineer with extensive experience in Azure Databricks. The successful candidate will be a part of a dynamic and innovative team, responsible for developing, maintaining, and testing data pipelines, and transforming data into a format that can be easily analysed. They will also be responsible for designing and implementing data models, structures, and integrations using Azure Data Factory. This role is an exciting opportunity for someone who is passionate about data and wants to make a significant impact in the insurance and finance industry.
Why join us?
- Competitive Base Salary
- Company paid health plan for employees
- Flexible Hours
- Very generous PTO
- Small team, autonomy
- Many more great perks!
Job Details
Responsibilities:
1. Design, build and launch new data extraction, transformation, and loading processes using Azure Data Factory.
2. Collaborate with data scientists, data architects, and business stakeholders to ensure data solutions are built for performance and are scalable.
3. Develop and maintain Databricks jobs for data transformations, data ingestion, and data delivery.
4. Implement complex big data projects with a focus on collecting, parsing, managing, analyzing, and visualizing large data sets.
5. Troubleshoot and resolve data processing issues and ensure all data systems meet company requirements.
6. Use Spark and Kafka to process and analyze large amounts of data.
7. Develop and implement data standards, ensuring data quality and consistency.
8. Stay up-to-date with the latest technologies and trends in the data engineering field.
Qualifications:
1. Bachelor’s degree in Computer Science, Information Systems, or related field.
2. 5+ years of experience as a Data Engineer or in a similar role.
3. Experience with Azure, Azure Data Factory, and Databricks is a must.
4. Proficiency in Spark, Kafka, and other big data tools.
5. Knowledge of data warehousing concepts, including data warehouse technical architectures, infrastructure components, ETL/ ELT, and reporting/analytic tools.
6. Experience in the insurance or finance industry is preferred.
7. Strong problem-solving skills, with the ability to troubleshoot and resolve complex issues.
8. Excellent communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.
9. Proven ability to work independently and as part of a team, managing multiple priorities in a fast-paced environment.
1. Design, build and launch new data extraction, transformation, and loading processes using Azure Data Factory.
2. Collaborate with data scientists, data architects, and business stakeholders to ensure data solutions are built for performance and are scalable.
3. Develop and maintain Databricks jobs for data transformations, data ingestion, and data delivery.
4. Implement complex big data projects with a focus on collecting, parsing, managing, analyzing, and visualizing large data sets.
5. Troubleshoot and resolve data processing issues and ensure all data systems meet company requirements.
6. Use Spark and Kafka to process and analyze large amounts of data.
7. Develop and implement data standards, ensuring data quality and consistency.
8. Stay up-to-date with the latest technologies and trends in the data engineering field.
Qualifications:
1. Bachelor’s degree in Computer Science, Information Systems, or related field.
2. 5+ years of experience as a Data Engineer or in a similar role.
3. Experience with Azure, Azure Data Factory, and Databricks is a must.
4. Proficiency in Spark, Kafka, and other big data tools.
5. Knowledge of data warehousing concepts, including data warehouse technical architectures, infrastructure components, ETL/ ELT, and reporting/analytic tools.
6. Experience in the insurance or finance industry is preferred.
7. Strong problem-solving skills, with the ability to troubleshoot and resolve complex issues.
8. Excellent communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.
9. Proven ability to work independently and as part of a team, managing multiple priorities in a fast-paced environment.
Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.
Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.