Prestashop import, manage and update 8000+ products and 400+ categories from CSV

I have a Prestashop installation and I have a CSV file with 8000+ products with 400+ categories in it. Each product has no variants but has like 10 images. This CSV changes everyday, it contains new products, erased products (SKU not anymore in the CSV), and several random updates of any value in it (prices, quantities, descriptions, SKU, etc).

The best solution should be whole import of the CSV each day, but looks like being impossible.

Since now I have made a PHP script that reads the CSV and outputs another CSV, that meets the Prestashop import in the admin backend. I have imported this huge CSV in steps of few hundred products.

Then I wrote another PHP script that everyday reads the original CSV and then changes some values inside the PS database (quantity, price, etc), getting the SKU as a reference. If the SKU is not present (so is a new product) it outputs another CSV with new products to import. That import has to be made manually in the PS admin > import csv.

Since now it is working fairly well, but it has many limitations, needs daily supervision and intervention, and is virtually impossible to check that all the 8000 products are really updated.

My question is, is there a better way to manage all this database? As I said, the best solution should be to rewrite all the product database each day, but I did not find any way to this solution.

I have tested the Prestashop Webservice but not working properly also for the amount of products.

(I don’t know also if Prestashop is the right solution, I was even thinking about writing a PHP product catalogue based on the original CSV and add PayPal “add to cart” functions)