31 Dec
2010
31 Dec
'10
8:40 p.m.
I plan to do bulk inserts within the driver - much like how the sql driver does bulk commits with explicit-commit turned on.
If that's the equivalent of insert () values (), (), () batching, then that's not what I mean. In MySQL, and similarly though not to the same degree in other DBMS's, bulk insert is very different from batched inserts. Specifically, a LOAD DATA in MySQL will yield upwards of 100k inserts/sec because it gets a full table write lock and buffers the inserts at the columnar data level, not the statement level. It's closer to batch writing sectors of disk, not rows of data. MS-SQL bcp and mongoimport behave similarly, though the difference isn't quite as pronounced as it is with mysqlimport on a MyISAM table.