Job Description
Position Summary:
The Data Engineer is responsible for building and maintaining data pipelines, ensuring the smooth operation of data systems, and optimizing workflows to meet business requirements. This role will support data integration and processing for various applications.
Minimum Qualifications:
9+ Years overall IT experience with minimum 4 years of work experience in below tech skills
Tech Skills:
Proficient in Python scripting and Spark for data processing tasks.
Strong SQL capabilities, with hands-on experience managing big data using ETL tools like Informatica.
Experience with the AWS cloud platform and its data services, including S3, Redshift, Lambda, EMR, Airflow, Postgres, SNS, and Event Bridge.
Skilled in BASH/Shell scripting.
Understanding of data Lakehouse architecture, particularly with Iceberg format, is a plus.
Preferred: Experience with Kafka and MuleSoft API.
Understanding of healthcare data systems is a plus.
Experience in Agile methodologies.
Strong analytical and problem-solving skills.
Effective communication and teamwork abilities.
Responsibilities:
Develop and maintain data pipelines and ETL processes to manage large-scale datasets.
Collaborate to design & test data architectures to align with business needs.
Implement and optimize data models for efficient querying and reporting.
Assist in the development and maintenance of data quality checks and monitoring processes.
Support the creation of data solutions that enable analytical capabilities.
Contribute to aligning data architecture with overall organizational solutions.
Job Tags
Full time, Part time, Work experience placement, Seasonal work,
Similar Jobs
EcoWay Voyagers
...Booking Agent at EcoWay Voyagers, you'll be a crucial part of our team, facilitating seamless travel experiences for our clients while promoting sustainability and responsible tourism. Working remotely, you'll utilize your exceptional organizational skills and attention to...
Boundless Life Sciences Group
..., built from the ground up to meet the evolving needs of modern healthcare brands. We are looking for a full-time Associate Creative Director/Art. The Associate Creative Director/Art mentors and supervises multiple art directors while helping to create outstanding work...
FOUR SQUARED SOLUTIONS
...Operations Coordinator Specialist /Commissions Specialist Four Squared Solutions is seeking a Operations Coordinator Specialist... ...authorization and employment eligibility verification requirements of the Immigration and Nationality Act and an E-Verify employer....
CalOpps
...Park is a great place to work! We are now hiring Recreation Specialists to provide hands-on support fora wide variety of programs including... ...required to provide a work permit.In accordance with the Immigration Reform and Control Act, all potential employees are required...
Circle Logistics
Class A CDL A Owner Operator Truck Drivers- Dedicated Dry Van Lanes- MI, IN, OH JobCDL A Owner Operators- Regional Dedicated Lanes- IN, OH, MI- West Chester, OH to Zeeland, MI, Zeeland, MI to Mt Vernon, IN, Evansville, IN back to Michigan or broker load back towards...