We are seeking a skilled Python developer to assist in building a script that can efficiently retrieve and store data from multiple RSS feeds. The script should be able to handle the parsing of different XML-based RSS formats and securely store the data as json files. The ideal candidate should have experience with Python and XML parsing. Attention to detail and the ability to write efficient and scalable code are essential for this project.
Details below:
Create a Python script that gets data from multiple RSS links provided in the URL "https://www.bcb.gov.br/acessoinformacao/rss" and save it in multiple json files.
In the "saving as json" process, the files must follow a specific folder structure and names.
In the future this script will be scheduled to run every 5 minutes, so I also need it to only save the json file when we find new data in the RSS feeds. So, to make it clearer: in the 1st execution, it will naturally save all the data / files. For further executions, it will only save a new json if the returned data contains new entries which weren't captured before. So, for each RSS, the script must compare the most recently saved file with the current execution data, deciding if we need a new file to be saved.
When saving the json (e.g. when new data is found), you can leave the “old” files as is, saving a new one with the full returned RSS data in the current execution. What I mean here is that you don’t need to worry about inserting new entries / keys / values to “old” json files.
More details will be shared before the beginning of the job.
This is the first step of a bigger project, so if the job goes well you should expect new jobs soon.
Thanks! =)
Budget: $60
Posted On: July 20, 2023 17:33 UTC Category: Scripting & Automation Skills:Python, Data Scraping, Python Script, Scripting
Skills: Python, Data Scraping, Python Script, Scripting Country: Portugal
