Share this Job

Big Data Lead Engineer/Architect

Job Title: Big Data Lead Engineer/Architect:


Job Location: Bangalore


Roles & Responsibilities:

•Lead Data Engineer would be responsible for overall Architecture & solutioning of projects on Hadoop platform.

•Ability to architect specific solutions to different technical problems related to data integration and processing.

•The resource would be responsible to evaluate IT architecture of different projects/systems, evaluate and define the integration mechanism of these systems.

•Ability to define and implement data ingestion mechanism from varies set of systems and modelling on this data on Hadoop platform.

•Ability to design and implement technical solution to achieve complex business KPIs.

•Ability to work with business stake holder and lead the functional and technical solution of the project which also includes creating functional and technical documentations.

•Working with junior engineers and BI engineers from various vendors and leading the Engineering effort.

•Ability to lead and execute multiple project in parallel working with varied set of business, IT and vendor stakeholders.

•Ability to run Scrum based projects.

•Ability to manage the workload of team and manage conflicting expectations.

•Ability to estimate the project efforts and timeliness and manage the projects to adhere to the timeliness.

•Ability to provide clear status of multiple projects and activities of his team.

•Ability to mentor and lead teams.


Strategic Impact:

•Impacts the effectiveness of own works team through the quality and timeliness of the work produced.

•Largely works within standardized procedures and practices to achieve objectives and meet deadlines and gains some discretion in problem solving.


Scope of People Responsibility:

•Responsible for managing the team

•Manage workload and task to scheduled execution of project.





•Communicates difficult concepts and negotiates with others to adopt a different view point.

•Fostering accountability throughout the team to uphold strong governance in the form of standards, methodology and requirements.

•Demonstrates the ability to work as a team member on a project, and is able to effectively work with a larger global team.


Qualification, Skills & Experience:

• Requires a graduate degree (or equivalent) that provides knowledge of theories, principles and concepts within a IT discipline.

•Overall 10+ year of experience in IT

•Minimum 3+ years experience on Hadoop/Big Data platform.

•Candidate should have extensive hands-on experience of Database and Data Warehouse projects.

•Candidate should have extensive hand-on experience on Hadoop data processing technologies.

•Candidate should have experience in managing projects and teams.

•Candidate should have experience and interpersonal skills for working with business clients across geographies.


Job specific Competencies & Skills:

•Highly committed Team Player

•Excellent written and Communication Skills

•Good negotiation skills to bring about a positive change.

•Strong Business Acumen

•Analytical and Problem Solving Skills.




•Hands-on in-dept knowledge of Hadoop, Sqoop, Hive, SQL, Pyspark/Spark, Oozie

•Hands-on experience on Python or Java or Scala is a must.

•Web Services, RestAPI

•Linux Shell Scripting

•Data Modelling

•Data warehousing exposure.

•Expert knowledge in SQL and HiveQL


•Project Management skills

•Good interpersonal and communication skills

•Knowledge of Agile methodology and tools like Jama/Jira


•Exposure to AWS Architecture and Services.

•Exposure to Tableau/Qlik etc.


Job Requisition ID:  184561
Location:  Bangalore SBS
Career Level:  E - Professional (10+ years)
Working time model:  full-time

Job Segment: Database, SQL, Developer, Java, Linux, Technology

Apply now »