Our client is the first online ad network to leverage social data on the Web. It was founded in 2010 and is based in San Francisco. The Company is engaged in Big Data technology.
We are looking for a Data Operations Engineer with the responsibility of automating, deploying, monitoring and performing error recovery of various data munging processes.
Duties:
- Support numerous ETL processes, mostly in Hadoop cluster;
- Perform failure investigations, identify root causes of errors and recovery;
- Monitor data munging processes, develop additional tools for monitoring (reports, alerts);
- Automate and deploy processes developed by data engineers and / or software engineers;
-
Perform standard procedures for:
- Adding new data feeds to the existing data pipeline;
- Adapting to changes in the format of incoming data feeds.
Required Skills:
- Strong knowledge of Linux;
- Demonstrated programming skills in Bash/Shell and Python, knowledge of Java or Perl would be a plus;
- Working knowledge of SQL (preferably MySQL): joins, grouping, indexes, query optimization;
- Experience of working with large data volumes (processing of more than 1 TB of data per day);
- Experience in analytical insights;
- Intermediate English
We offer:
- Benefits, including insurance with optional dental care;
- Office tea, coffee and snacks;
- Possibility to increase your experience and expertise (including English) through various courses at the Company expense;
- A partial compensation costs for fitness;
- Possible business trips to USA.
Подраздел:
SQL, Linux, Big Data