Database Automation Scripts In Development

I have spent the last two days writing translation scripts in PHP for the back-office side of the affiliate websites. The main issue is a lack of consistency between affiliate companies and their members in regards to the quality of information provided. I took a look at the datafeeds from all the affiliate companies we signed up with earlier on in the week. I then worked out what colums I would need in the final live MYSQL database table and have started writing PHP scripts that read from one MYSQL table and migrate relevant columns across to the new table and dumping the rest.

This is now working for Affiliate Window and Webgains and I will work on Tradedoubler next.

Once I am able to automatically populate my master MYSQL table with any datafeed, the next task is to write a series of ‘translator scripts’ based on different products and to create affiliate MYSQL tables for each - e.g. I am current working on a football based table script that grabs relevant football data from across all affiliate companies and then translates it into meaningful data in one final table. This will never be 100% as the system is simply looping through a number of regular expressions to find the required data.

However, I have it running on my development machine at home and it is able to process approximately 20,000 lines of raw data from several excel spreadsheets and within 10 minutes have all the data sifted, sorted and populated into the correct database.

Once I have this running as well as I can, it should only require a few minor tweaks to keep it running indefinitely and I can move onto the next product category. In this way, I hope to develop 4-6 affiliate product areas per month and, once created, these scripts should allow me to populate an infinite number of spin-off affiliate selling websites.

Related Blogs

  • Related Blogs on webgains
We always appreciate the support:
  • Digg
  • Technorati
  • del.icio.us
  • Facebook
  • Mixx
  • Google
  • De.lirio.us
  • Furl
  • StumbleUpon

2 Responses to “Database Automation Scripts In Development”

  1. Sounds very interesting… would you consider selling this application?

  2. I could do however it is very product / affiliate specific. It would be easier to explain how I do it and then you can create your own database automation script.

    Let me know if you want any help and I’ll see what I can get to you.

Leave a Reply