ETL Solution Architect Job at VDart Inc, Remote

RXdlSmlQUFZxZlBvbnVITlllMm1CQlVTbHc9PQ==
  • VDart Inc
  • Remote

Job Description

Job Title: ETL Solution Architect

Location: Canada Remote

Duration: / Term: 6+ months Contract

Job Description :

  • Has worked in the past as architect in the past.
  • Professional experience in Data Engineering using Google Big Query (GBQ) and Google Cloud Platform (GCP) data sets and building data pipelines.
  • Hands on and deep experience working with Google Data Products (e.g. BigQuery, Dataflow, Dataproc, Dataprep, Cloud Composer, Airflow, DAG etc.).
  • Python Programming Expert PySpark, Pandas
  • Experience in Airflow (Create DAG, Configure the variables in Airflow, Scheduling)
  • Big Data technologies and solutions (Spark, Hadoop, Hive, MapReduce) and multiple scripting and languages (YAML, Python).
  • Experience in DBT to create the lineage in GCP. Optional
  • Worked in Dev-Sec-Ops (CICD) environment.
  • Design and develop the ETL ELT framework using BigQuery, Expertise in Big Query concepts like Nested Queries, Clustering, Partitioning, etc.
  • Experience in Data Integration, Data Transformation, Data Quality and Data Lineage tools.
  • Should be able to automate the data load from Big Query using APIs or scripting language.
  • E2E Data Engineering and Lifecycle (including non-functional requirements and operations) management.
  • E2E Solution Design skills Prototyping, Usability testing and data visualization literacy.
  • Experience with SQL and NoSQL modern data stores.

Key Skills:

GCP, Google Big Query, Python, ETL, BigQuery, Data Integration, Data Transformation, Data Quality

Job Tags

Contract work, Remote job,

Similar Jobs

Luverne Health And Rehabilitation LLC

Licensed Nursing Home Administrator Job at Luverne Health And Rehabilitation LLC

 ...Join Our Team and Make a Difference! We are seeking a dynamic and compassionate Licensed Nursing Home Administrator to lead our dedicated team. As the Administrator, you will play a crucial role in ensuring the highest quality of care for our residents while overseeing... 

Global Channel Management, Inc.

3rd Shift Machine Operator Job at Global Channel Management, Inc.

3rd Shift Machine Operator needs 1+ years' experience with 3rd Shift Machine Operator requires: Ability to lift 50 pounds 3rd shift 3AM to 11:30AM 11PM to 7:30AM 7PM to 3:30AM Able to handle multiple Printers Operates our Xerox fleet of printers -288... 

BlueCross BlueShield of South Carolina

Consultant education Job at BlueCross BlueShield of South Carolina

 ...Summary As a Senior Provider Education Consultant, you will provide education to medical providers as warranted. You will also serve...  ...earn. ~ Nine paid holidays. ~ On-site cafeterias and fitness centers in major locations. ~ Wellness programs and healthy... 

Sorting Robotics

Marketing & Brand Manager for Cannabis Tech Startup Job at Sorting Robotics

 ...revolutionizing the industry with our robotic innovations. We are seeking a Marketing & Brand Manager to join our team and play a key role in driving...  ...brand awareness and drive sales. Create and execute digital marketing campaigns across various platforms. Manage... 

Onebrief

Partner Engagement Manager, U.S. Indo-Pacific Command Job at Onebrief

 ...understand large military headquarters and want to apply that within U.S. Indo-Pacific Command. Skillful planners, mainly SAMS, JAWS...  ...know youve taken care of it. You can get things from large government organizations Example: our engineer needs admin access to a...