This job was posted over 90 days ago and may no longer be available.

Founding Data Engineer, Architect

You will design and maintain infrastructure for collecting, storing, processing, and analyzing huge sets of data. You will be responsible for choosing the best solutions and then implementing, maintaining, and monitoring them. You will design to make data highly available for both our web app and our internal researchers. You will provide high level insights that are relevant to business development as well as machine learning researchers.

What we’re looking for:

We're looking for someone who has managed huge data sets, both streaming and stores, and is ready to take the lead in designing optimal solutions for our products. You need a strong understanding of distributed computing principles. A good understanding of simple machine learning algorithms and the ability to communicate insights is essential. You should have experience implementing a variety of ETL techniques and frameworks and the ability to rapidly quality-check and clean data for consumption in machine learning algorithms. Therefore experience with streaming processing such as Spark is useful and experience with messaging systems such as Kafka is a plus. Experience with NoSQL databases that scale, such as Cassandra, is also a plus. We would like someone who has experience implementing Elastic.

Things we like:

We use Amazon Web Services and are intent on being agile and efficient. We have data coming in from a variety of sources, including user interactions, and we're excited about technology that can process this live and integrate it with our machine learning architecture. We want someone who will be happy working in an environment that values good software engineering, taking the time to automate workflows, data pipelines, and produce replicable and extensible code with good version control practices and unit testing. We love data analysis and would like you to too.

Compensation

  • $70K – $90K
  • 0.5% – 1.0%

Desired Skills

Contact Info

Posted: Feb. 4, 2017

Apply


Get Updates