brand logo
View All Jobs

AWS Big Data Engineer

Chennai, Bangalore, Hyderabad
Job Description

We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch processing on the Big Data platform.

● Set up and run Hadoop development frameworks.
● Collaborate with a team of business domain experts, data scientists, and application developers to identify relevant data for analysis and develop the Big Data solution.
● Explore and learn new technologies for creative business problem-solving.
#LI-UNPost
Job Requirement

 Ability to develop and manage scalable Hadoop cluster environments
● Ability to design solutions for Big Data applications
● Experience in Big Data technologies like HDFS, Hadoop, Hive, Yarn, Pig, HBase, Sqoop, Flume, etc
● Working experience on Big Data services in any cloud-based environment.
● Experience in Spark, Pyspark, Python or Scala, Kafka, Akka, core or advanced Java, and Databricks
● Knowledge of how to create and debug Hadoop and Spark jobs
● Experience in NoSQL technologies like HBase, Cassandra, MongoDB, Cloudera, or Hortonworks Hadoop distribution
● Familiar with data warehousing concepts, distributed systems, data pipelines, and ETL
● Familiar with data visualization tools like Tableau
● Good communication and interpersonal skills
● Minimum 6+ years of Professional experience with 3+ years of Big Data project experience
● B.Tech/B.E from reputed institute preferred
#LI-UNPost