Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

STREektVTnRKZ0t0aG5ZQTZIQ1BtKytJYkE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Michael Page

Director of Operations - Commercial General Contractor Job at Michael Page

 ...Jump into a Leadership role with a growing General Contractor Strong compensation package with bonus earning potential About Our Client They are are a family-owned General Contractor with nearly 30 years of experience in the local KC market.. They particularly... 

InterSources

Data architect Job at InterSources

Job Title: Data ArchitectWork Location: Chicago, ILDuration: PermanentPosition Summary:Interview Mode: Video Design and implement enterprise-wide data architecture strategies Develop data models, schemas, and data flow diagrams Develop data models and metadata... 

Ohana Clips

Cosmetologist/Barber/Hair Stylist Job at Ohana Clips

 ...make an impact in your community. The recognition you deserve for a job well done. Hair Stylist/Barber Qualifications: Cosmetology and/or Barber License. The passion to build genuine connections with customers and provide GREAT haircuts. The desire to... 

Kaav Inc.

Business Analyst (Salesforce and GraphQL) WLK SMT MMK BOS Job at Kaav Inc.

Business Analyst Consultant As a Business Analyst Consultant, you blend deep experience in health care benefits and product development with a passion for analysis, harnessing technology to solve complex challenges.

ClearanceJobs

Security Guard - Armed Secret Clearance Government Site Job at ClearanceJobs

Security Guard - Armed Defense Patrol Allied Universal, North America's leading security and facility services company, offers rewarding careers that provide you a sense of purpose. While working in a dynamic, welcoming, and collaborative workplace, you will be part...