Search Jobs
Browse the latest opportunities at TPI Global.
TPI Global (formerly Tech Providers, Inc.)
https://techproviders.com/wp-content/uploads/2022/06/Logo-Color.png
http://www.tpiglobalsolutions.com
http://www.tpiglobalsolutions.com
true
Data Engineer III
Jackson, MI US
Posted: 05/22/2024
2024-05-22
2024-07-20
Job Number: 22218130
Job Description
Data Engineer III
6+ Months Contract
100% Remote
Job Duties:
6+ Months Contract
100% Remote
Job Duties:
- As a Senior Azure Data Engineer, your role involves designing, implementing, monitoring, and maintaining data and analytical solutions on Microsoft Azure.
- Data Pipeline Design and Implementation:
- Create and maintain data pipelines that facilitate data movement, transformation, and integration
- Ensure efficient and reliable data flow from source systems to target destinations
- Data Storage Solutions:
- Design and manage data storage solutions within Azure, including:
- Azure Data Lake: Storing large volumes of raw data
- Azure SQL Database: Providing structured data storage
- Azure Blob Storage: Handling unstructured data
- Data Processing and Transformation:
- Expertise in Databricks and dbt to process and transform data
- Leverage Azure Databricks for running dbt transformations in production
- Data Integration:
- Collaborate with data analysts and scientists to understand data requirements.
- Design effective data workflows that enable data-driven decision-making.
- Performance Optimization:
- Optimize SQL queries generated by dbt for better performance.
- Ensure consistency between development (using a Databricks SQL warehouse) and production (using Azure Databricks compute) environments
- Security and Compliance:
- Implement secure and compliant data processing pipelines.
- Use Azure services and frameworks to produce cleansed and enhanced datasets for analysis
- Expertise in Microsfot Azure, Azure Databricks, and DBT
- Knowledge of data catalog tools (e.G., Microsoft Purview)
- Proficiency in data processing languages, including SQL and Python
- Excellent problem-solving skills and ability to work in a collaborative environment
Meet Your Recruiter
Share This Job:
Related Jobs:
Login to save this search and get notified of similar positions.About Jackson, MI
Explore exciting job opportunities in and around Jackson, Michigan! Known as the "Waterloo of the North," Jackson is a charming city with a rich history and vibrant community. Nestled between Detroit and Chicago, this area offers a perfect blend of small-town charm and big-city amenities, making it an ideal location for job seekers seeking growth and opportunity. From the Cascades Falls Park to the Ella Sharp Museum and the Michigan Theatre, there's no shortage of culture and entertainment. Indulge in delicious Coney Island hot dogs or visit the Cell Block 7 Prison Museum for a unique experience. With easy access to Lake Michigan and the vibrant arts scene, Jackson, MI is the perfect place to start or advance your career!