Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

NG5ITzlNMWpySHY0ZEl0bnlLU3JnSy9wS3c9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

AO Globe Life

Benefits Consultant VIRTUAL POSITION Job at AO Globe Life

 ...position, designed for new graduates ready to build professional experience in sales, client relations, and financial serviceswith full...  ...skills in sales, leadership, and client relationship management Work from anywhere with internetno commuting, no cubicle... 

LaBella Associates

Environmental Analyst Job at LaBella Associates

 ...We are currently seeking a qualified Environmental Analyst to work in our Albany, Glens Falls, or Poughkeepsie office in our Environmental...  ...commensurate with experience. ~ Fast-paced environmental consulting/engineering practice. Salary Range: $50,000 - $60,000... 

Spire Orthopedic Partners

Sterile Processing Technician Job at Spire Orthopedic Partners

 ...What You'll Do Responsible for the day-to-day activities in Sterile Central. Responsible for decontamination, assembly of kits, operation...  ...sterilization, including all monitoring of these sterilization processes. Maintains adequate inventory for Sterile Central and Surgical... 

Griswold Care Pairing for Sarasota County

CNA/HHA Job at Griswold Care Pairing for Sarasota County

Needing help with a client in Englewood for every saturday and sunday 8am-6:30pm. Client has dementia, needs help with meal prep and light housekeeping. Most of her meals need to be pureed. She has high anxiety so she needs to be assured that things are going to be ok.

State of Florida

SENIOR HEALTH EDUCATOR - 64041301 Job at State of Florida

 ...Requisition No:867557 Agency: Department of Health Working Title: SENIOR HEALTH EDUCATOR - 64041301Pay Plan: Career Service Position Number:...  ...DEPARTMENT OF HEALTH - HILLSBOROUGH Division of Community Health Office of Minority Health Senior Health...