Data Manipulation: 65,000+ products

[tbogus]

I realize that this is most likely a wild shot in the dark, but I'll try anyway.

We're nearing a very definitive threshold of number of products in our miva 4.24 store: 65,000. I've heard that some miva merchant stores have large amounts of products as we do.

Considering the threshold of number of records in Excel is around 65,000 how do people manage their manipulation of products, such as creating feeds, etc. when faced with this challenge?

I realize that it is possible to break an export into parts using miva merchant but my main hope for this thread is to see if people have found viable tools that allow them to edit vast amounts of records, when excel won't cut it.

Your help is appreciated.

Tim.

[dotCOM_host]

You could get a newer version of Excel, where the maximum number of rows has been greatly increased past the old ~64000 limit. Or, if you are using v5 with mySQL, you could build your own quick front-end to do massive store updates - though this approach will require some programming and some mySQL knowledge.

[tbogus]

Hi Remik. Yes, we are going to upgrade to the newer version of excel. Unfortunately even the upgrade prices add up when you're talking multiple computers within a company it all adds up, as I'm sure you know.

We're planning on upgrading to miva 5 within the next six months, so thank you for the suggestions - they are much appreciated.

Tim.

[dotCOM_host]

Yes, it can quickly add up if you have multiple computers, but an upgrade to Excel 2007 can be bought for only $86 online... If you were to build your own front-end interface, chances are it would take you several hours (at least), not including debugging and ongoing updates - which overall could be much more expensive than just buying the Excel upgrade. Chances are you'll upgrade Excel or the entire Office suite sooner or later anyway, right? :-)

Just FYI, Excel 2007 has a 1-million rows limit.

[ids]

I've had client that use a db application like Filemaker. I've played with it little and it is pretty flexible and capable. Exporting to flat files should be easy. Building an interface isn't that difficult either.

Just a thought.

Scott

[tbogus]

Thanks Guys. Yeah, I know that upgrading Excel is what's going to happen in the end. I'm just trying to find a more cost-efficient workaround until we can invest in all the necessary copies of Excel.

Thanks,
Tim.

[Brandon MUS]

The most cost effective would be to break it up in to 2 exports then.

What kind of upgrades are you talking about exactly? No mater what method you chose, 65,000 changes will take a long time. Is it something simple like capitalization? Something find and replace or even regular expressions rules could do for you?

[tbogus]

Like I said earlier I'm mainly concerned about manipulating the data for various feeds.

I don't even want to begin to imagine what it would be like to have to update all 65,000+ products.

Tim.