• ETL Developer (Big Data Engineer)

Industry Financial Services(FS)
Location Telangana Hyderabad
Experience Range 4 - 10 Years
Open

Job Description
About Us
Ness is a global leader in digital transformation, we are a full lifecycle digital engineering firm offering digital advisory through scaled engineering services. With 20+ years of specialization in product and platform engineering, we design, build, & integrate digital platforms and enterprise software that help organizations to engage with customers, differentiate their brands, and drive profitable growth for them. Our experienced designers, software engineers, data experts, and business consultants, partner with clients to develop roadmaps that identify ongoing opportunities to increase the value of their digital solutions and enterprise systems. The exciting work happens through 11 innovation hubs with 4000+ Nessians located across the globe.
About Company
.
Roles and Responsibility

Involved in building and designing of new data pipelines for ingestion using Sqoop and transformation using Apache Spark with Java/PySpark.

Experience in Big Data ecosystem related technologies like Storm, development of Spark streaming with Kafka, NiFi, HBase, Phoenix and Hive.

Experience  in   Apache spark(core & structured streaming ) using scala

Experience in Administration, configuration management, monitoring, debugging and performance tuning of Hadoop applications, YARN and HDFS.

Exploring with the Spark on improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, SparkSQL, Data Frames.

Managing and monitoring data using Hive/ HQL.

 

Desired Skills

Job Description:

experience in Apache Spark

experience in java & Hive

Python experience +

HDFS

Bigdata

SQL

DB2

Data Engineering

 

Recruiter Name chandru
Recruiter Number NA
Recruiter Email Id chandru.thavuru@ness.com
A+| A| A-