Python Data Engineer
Remote - North and South America / Full Time
Parse.ly is a real-time content measurement layer for the entire web.
Our analytics platform helps digital storytellers at some of the web's best sites, such as Arstechnica, The New Yorker, TechCrunch, Wired, The Intercept, Slate, and many more. In total, our analytics system handles over 65 billion monthly events from over 1 billion monthly unique visitors.
On the open source front, we maintain streamparse, the most widely used Python binding for the Apache Storm streaming data system. We have also contributed to the development of high-performance Kafka client libraries for Python.
Our colleagues are talented: our UX/design team has built one of the best-looking dashboards on the planet, using Vue.js and D3.js, and our infrastructure engineers have built a scalable, devops-friendly cloud environment, using tools like Ansible and Terraform.
As a Python Data Engineer, you will help us expand our reach into the area of petabyte-scale data analysis — while ensuring consistent uptime, provable reliability, and top-rated performance of our backend streaming data systems.
Parse.ly’s data engineering team already makes use of modern technologies like Python 3, Storm, Spark, Kafka, and Elasticsearch to analyze large datasets. As a Python Data Engineer at Parse.ly, you will be expected to master these technologies, while also being able to write code against them in Python, and debug issues down to the native C code and native JVM code layers, as necessary.
This team owns a real-time analytics infrastructure that processes over 2 million pageviews per minute from over 5,000 high-traffic sites. It operates a fleet of cloud servers that include thousands of cores of live data processing. We have written publicly about mage, our time series analytics engine. This will give you an idea about the kinds of systems we work on.
For this role, you should already be a proficient senior Python programmer who wants to work with data at scale.
In the role, you’ll...
We are a fully distributed team, which means 100% of our engineers, designers, and product managers (including our founders & management team) work out of home offices. This has been true for years, long before the pandemic switched people's work styles -- so we have a thoughtful approach to fully distributed collaboration that has been refined over time.
Most of the product team is located in US/Eastern and US/Central timezones. We'll give preference to those timezones, because even though we operate on a distributed/async model, we like to have timezone overlap for f2f (video) collaboration and pairing. We prefer to hire US-based candidates, but we'll consider other timezone-aligned locations in North and South America for this role.
In February 2021, Parse.ly was acquired by Automattic's enterprise software division, WPVIP. Automattic is one of the biggest champions of open source and the open web, and also one of the top fully distributed employers in the world. Though you will interview for the Parse.ly team within WPVIP and Automattic, if you receive a job offer, it will be to become an Automattician, which means having colleagues who observe the Automattic creed and getting access to Automattic's excellent employee benefits. Your benefits will include:
Automattic's benefits can vary by location. The above describes US-based staff. See our benefits based on where you are in the world.
We’re improving diversity in the tech industry. At Parse.ly and our parent company, Automattic, we want people to love their work and show respect and empathy to all. We welcome differences and strive to increase participation from traditionally underrepresented groups.
Studies have shown that women and people of color tend not to apply for jobs unless they feel they meet exactly all items in the job description. We believe that high-performing teams include people from different backgrounds and experiences who can challenge each other’s assumptions with fresh perspectives. We encourage you to apply, even if you don’t match everything listed in the job description. Let us know why this role appeals to you, why you will be great, and which requirements will stretch you.
We are an equal opportunity employer who values and encourages diversity and belonging at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.