"Christopher" == Christopher Meiklejohn <cmeiklejohn@basho.com> writes:
Christopher> I’m a bit concerned with your use of the set embedded in the Christopher> map. The original idea was to use a Set directly. The Set-in-Map thing was just a thought experiment (Map-in-Set would make more sense). Christopher> Large objects have traditionally been a big problem in Riak due Christopher> to the use of distributed Erlang and head of line blocking. I’m Christopher> curious if you could elaborate on what type of data you will be Christopher> storing in the set: how big you expect each item to be, how big you Christopher> expect the map to be, and the overall layout of data inside of the Christopher> data structure. The intention is to store log messages in each element of the set: either as a string (syslog or json, or whatever else the user sees fit), or as a map of key-value pairs (where values themselves can be maps too). On average, the log messages are a few kilobytes in size. There may be exceptions, but >1mb ones are fairly rare. How much data the set would hold... now that's a question that can't really be answered. It is really up to the syslog-ng user to configure that. Hope that made it a little more clear. -- |8], mentor for the riak destination for syslog-ng GSoC project