Data Driven Python Engineer
2 semanas atrás
We are seeking an experienced Data Driven Python Engineer to lead efforts in social media data scraping and automation at Paradise Media. The ideal candidate will have a strong expertise in web automation to extract data efficiently and ensure quality.
About the RoleThe Senior Python Developer at Paradise Media will be responsible for implementing scalable data processing solutions using SQL and NoSQL systems, while leveraging AWS-based infrastructure to serve the data. Additionally, the developer needs to have an understanding of LLM customizations for decision making and content generation.
This position plays a crucial role in driving business insights through optimized data handling and automation processes. The successful candidate will work closely with our team to develop and maintain web scraping scripts using Python to collect data from social media platforms and websites in an efficient and scalable manner.
The ideal candidate will have experience with setting up and managing high load asynchronous data processing systems using SQS, Lambda Functions, and Docker. Strong problem-solving skills and attention to detail are essential for this role. Excellent communication skills and ability to work collaboratively in a remote team environment are also required.
We offer a competitive salary, and the opportunity to work with a talented and passionate team in a fast-paced, dynamic environment.
Key Responsibilities:- Develop and maintain web scraping scripts using Python to collect data from social media platforms and websites
- Build and maintain data-driven web applications with Django, ensuring optimal performance, data consistency, and scalability across different data sources
- Simulate HTTP requests and parse HTML outputs to extract and process necessary data
- Ensure data quality, accuracy, and consistency across different data sources by implementing validation processes
- Develop and implement solutions utilizing LLMs, such as Retrieval-Augmented Generation (RAG) and embeddings, to analyze Social media content and assist in drafting engaging social media posts
- Set up and manage CI/CD pipelines and infrastructure on AWS using Terraform to automate deployment and scaling
- Proven experience as a Python Developer with a focus on developing web applications, back-end APIs, web scraping, and data extraction
- Strong proficiency in Python, specifically Python Frameworks like FastAPI, Django and libraries such as BeautifulSoup, Scrapy, and Selenium
- Nice-to-have: Experience with LLMs (e.g., RAG, embeddings) for content analysis and generation
- Understanding of RESTful APIs and experience integrating with third-party APIs
- Knowledge of data processing and storage solutions, including databases (e.g., SQL, NoSQL)
- Experience with AWS and setting up infrastructure from scratch, including CI/CD pipelines and using Terraform
-
Data Engineer
3 semanas atrás
Brasil Insight Global Tempo inteiroMust-haves: 5+ years of data engineer experience Experience working with AWS architecture (RDS, Glue, EMR, EC2, S3, Postgres, EMR, etc..) Snowflake data warehousing Python & SQL coding Day to Day: Insight Global is looking for 3 remote data engineers to join the analytics organization at a global medical device client. We are establishing a new data...
-
Insight Global | Data Engineer | brasil
3 semanas atrás
brasil Insight Global Tempo inteiroMust-haves:5+ years of data engineer experience Experience working with AWS architecture (RDS, Glue, EMR, EC2, S3, Postgres, EMR, etc..)Snowflake data warehousingPython & SQL codingDay to Day:Insight Global is looking for 3 remote data engineers to join the analytics organization at a global medical device client. We are establishing a new data analytics...
-
Insight Global | Data Engineer | brasil
3 semanas atrás
brasil Insight Global Tempo inteiroMust-haves: 5+ years of data engineer experience Experience working with AWS architecture (RDS, Glue, EMR, EC2, S3, Postgres, EMR, etc..) Snowflake data warehousing Python & SQL coding Day to Day: Insight Global is looking for 3 remote data engineers to join the analytics organization at a global medical device client. We are establishing a new data...
-
Data Engineer
4 semanas atrás
Brasil Remobi Tempo inteiroData Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world....
-
Data Scientist and Engineer
Há 1 mês
Brasil PALO IT Tempo inteiroData Engineer Job DescriptionAt PALO IT, we're looking for a skilled Data Engineer to join our team. As a Data Engineer, you'll play a critical role in supporting and enhancing a data-driven culture throughout the organization.Main ResponsibilitiesMaintain and develop the data flow on the Big Data platform.Design and build robust and scalable data...
-
Data Privacy Engineer for Blockchain Intelligence
4 semanas atrás
Brasil Data Privacy Tempo inteiroAbout TRM LabsTRM Labs is on a mission to build a safer financial system for billions of people. As a blockchain intelligence data platform provider to financial institutions, crypto companies, and governments, we deliver cutting-edge solutions to fight cryptocurrency fraud and financial crime. Our sustainable approach ensures our business and profit align...
-
Data Engineer
Há 7 dias
Brasil Remobi Tempo inteiroWe are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. Because it doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. Our clients access our community to...
-
Data Engineer
2 semanas atrás
Brasil WEX Inc. Tempo inteiroCompany OverviewWEX Inc. is a global commerce platform that helps businesses simplify operational complexities, providing innovative solutions to manage and mobilize fleets, streamline payments, and offer employee benefits. Our company operates in over 200 countries and territories, working with large and small companies to tailor our services to meet their...
-
Data Engineer
3 meses atrás
Brasil Remobi Tempo inteiroData Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world....
-
Senior Data Engineer
4 meses atrás
Brasil inspired! Tempo inteiro** PLEASE CONSIDER THE REQUIRED QUALIFICATIONS AND ENGLISH PROFICIENCY FOR THIS POSITION ** We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and optimizing data pipelines and architectures. You will leverage your Azure, Databricks, Data Warehousing, SQL, and...
-
Data Engineer
3 meses atrás
brasil Remobi Tempo inteiroData Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...
-
Data Engineer
3 meses atrás
brasil Remobi Tempo inteiroData Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. Our...
-
Data Engineer with GCP
Há 7 dias
Brasil AllianceIT Inc Tempo inteiroThis position is a Remote position to work from on in LATAM working with US clients. You will be working as a consultant directly with clients US Clients. Must work in US PST Zone. We offer: 100% Remote Position Paid National Holidays off $30 to $35 USD per hour Title: Data Engineer with GCP We are seeking a highly motivated and experienced Data...
-
Remobi | Data Engineer | brasil
3 semanas atrás
brasil Remobi Tempo inteiroData Engineer - (REMOTE) BrazilAbout Remobi:We are building the world's greatest community of remote technologists!Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world.Our...
-
Remobi | Data Engineer | brasil
2 semanas atrás
brasil Remobi Tempo inteiroData Engineer - (REMOTE) Brazil About Remobi: We are building the world's greatest community of remote technologists! Today, organizations that understand the value of remote working will reap the rewards. It doesn’t just provide team members with a healthier work-life balance, it gives you the opportunity to access the brightest minds in the world. Our...
-
Senior Azure Data Factory Engineer
4 semanas atrás
Brasil SGF Global Tempo inteiroCompany Overview:SGF Global is a leading provider of data-driven solutions. We are seeking an experienced Senior Azure Data Factory Engineer to join our team.Estimated Salary: $120,000 - $180,000 per yearJob Description:As a Senior Azure Data Factory Engineer at SGF Global, you will be responsible for designing and implementing scalable data pipelines using...
-
Senior Data Architect, South American Airlines
4 semanas atrás
Brasil DataArt Solutions, Inc Tempo inteiroAt DataArt Solutions, Inc, we are seeking a skilled Senior Data Architect to join our Advanced Analytics team. As a key member of our team, you will play a crucial role in designing and implementing scalable data pipelines that enable the creation of custom data products based on analytical models.The ideal candidate will have at least 2 years of experience...
-
brasil AllianceIT Inc Tempo inteiroThis position is a Remote position to work from on in LATAM working with US clients. You will be working as a consultant directly with clients US Clients. Must work in US PST Zone. We offer: 100% Remote Position Paid National Holidays off $30 to $35 USD per hour Title: Data Engineer with GCP We are seeking a highly motivated and experienced Data Engineer...
-
brasil AllianceIT Inc Tempo inteiroThis position is a Remote position to work from on in LATAM working with US clients. You will be working as a consultant directly with clients US Clients. Must work in US PST Zone.We offer:100% Remote PositionPaid National Holidays off$30 to $35 USD per hourTitle: Data Engineer with GCPWe are seeking a highly motivated and experienced Data Engineer to join...
-
Senior Data Engineer
3 semanas atrás
Brasil Blankfactor Tempo inteiroThis is a remote position as a contractor paying in USD. Please apply with your English CV and only if you hold a minimum B1 English comprehension level. About Blankfactor At Blankfactor, we are dedicated to engineering impact. Our passion lies in delivering best-in-class tech solutions that enable companies to transform, innovate, and scale. We...
