Please allow ads on our site
Kindly log in to use this feature. We’ll take you to the login page automatically.
LoginConnect Scrapy crawler with S3
General Tech Bugs & Fixes 3 years ago
User submissions are the sole responsibility of contributors, with TuteeHUB disclaiming liability for accuracy, copyrights, or consequences of use; content is for informational purposes only and not professional advice.
No matter what stage you're at in your education or career, TuteeHUB will help you reach the next level that you're aiming for. Simply,Choose a subject/topic and get started in self-paced practice sessions to improve your knowledge and scores.
Similar Forum
Explore Other Libraries
Online Exams
Question Bank
Career News
Feeds
Full Forms
Dictionary
Interview Question
Gigs
Quotes
Lyrics
Videos
Courses
Blogs
Tutorials
Forum
Educators
Corporates
Tools
Please allow ads on our site
Kindly log in to use this feature. We’ll take you to the login page automatically.
Login
manpreet![Tuteehub forum best answer]()
Best Answer
3 years ago
My crawler download from a URL a Request.body which I save on a file locally. Now I would like to connect to my aws-s3. I read the documentation but face two issues: 1. the config as well as the credential files are not of a dict type? my file is an unmodified was-credential and aws-config files. 2. the Response is a 'bytes' one and cannot not be processed by the feeder as such.