scrapy Getting started with scrapy Creating a project

Example

Before starting work with scrapy you have to start a project where you want to store your code. Enter the directory and run this code

scrapy startproject helloProject

The third part of this code is project name. This code will create a "helloProject" directory with the following contents:

helloProject/
    scrapy.cfg            # deploy configuration file

    helloProject/         # project's Python module, you'll import your code from here
        __init__.py

        items.py          # project items file

        pipelines.py      # project pipelines file

        settings.py       # project settings file

        spiders/          # a directory where you'll later put your spiders
            __init__.py