Automotive Website with Listing Management Solution

What we need; Development, implementation & support of the Website, Automotive Listing Management Solution and the Crawlers What we ask; Fully commented code, developed using python , django , mongodb , html5 , javascript ,css3 open source solutions, documentation & support. General consideration; We want the software/site in English. Tier 1 Dev; Crawlers & DB ; Development & Implementation ; Estimated time; 1 Month A. Develop and implement 3 web crawlers to run continuously as a batch job in background updating the mongodb and tracking information changes from sites List; [login to view URL] [login to view URL] [login to view URL] The scraper should retrieve ALL the information about the listing and store it directly on our DB. The script should also be able to detect duplicate autos and avoid them. We prefer Python (Scrapy) scripts for the crawlers but this could be implemented in some other language. In the ideal scenario the script should never stop running. A second script for each crawler should be also developed and implemented in order to clean the DB and remove un-published listings. You will also have to create a [login to view URL] where a site admin may be able to see the scrapper progress, restart it, see logs, stop, etc B. We will provide the DB structure for you to work with, but any optimization suggestions are welcome on this matter Tier 2 Dev; Automotive Listings Management Solution; Development & Implementation; Estimated time; 2 Weeks Three Ways to Add Support Dealer listings 1. FTP “Multiple FTP Files will need to be supported from Multiple Dealers” 2. Crawler 3. Manual Upload Tier 3 Dev; HomePage & ResultPage ; Development & Implementation ; Estimated time; 1 Month A. Site must be developed in python , django , mongodb , html5 , javascript ,css3. No flash, no xhtml. Web2.0 look is required, we will be working with CSreview on this. Code must be as clean as it can be. Portfolio needed. End Product to Function Like: [login to view URL] and [login to view URL] Site Features: Cars for Sale with Results and Detail Page Sell a Car Dealer Sell a Car Private Party B. Site must be implemented with an API. C. SEO - Feeds -> Searches must have its own feed auto-created for later search. - Friendly URL -> URL of the listings must be also auto-generated and cached for search engines, this must include no more than 3-5 words in your URL like -> /2007-ford-f150/truck-for-sale/fairfield-ca-94533/144082418-9 - Cache Search -> Caches URL must be dynamically added to -> [login to view URL] - URLs must be in lower case - NO FRAMES @all - Title Tag & Meta Tags - Alt Attributes on Images - Dashes, no underscores. - Social Integration -> +1 & Facebook Like Friendly Results URL -> URL :By Manufacture, Make, Model, Dealer, State, City, Zip code/Postal code Friendly Results URL -> URL of the listings must be also auto-generated and cached for search engines, this must include no more than 3-5 words in your URL like -> /ford/cars-for-sale Note; Final site will compete against [login to view URL], [login to view URL], [login to view URL], [login to view URL], [login to view URL] We will be bidding out many other phases of project such as mobile technology in the future.