* [Bismark-devel] FCC app progress: django @ 2011-04-18 5:57 Nick Feamster 2011-04-18 7:57 ` [Bismark-devel] [Hndr] " Nick Feamster 2011-04-18 12:18 ` Dave Taht 0 siblings, 2 replies; 13+ messages in thread From: Nick Feamster @ 2011-04-18 5:57 UTC (permalink / raw) To: Srikanth Sundaresan, Abhishek Jain, Walter de Donato Cc: <hndr@lists.pixilab.org>, bismark-devel (sorry for list cross-posting) Srikanth, Abhishek, Walter, Small, slow progress on the FCC app--- I have a written a very simple server with django. I've got the django server hooked up to our bismark mysql database. It's basically a slick python wrapper for doing Web development with a database back-end. The setup is ugly right now, but it's a proof of concept, and it works (django is talking to our back-end). For example: http://networkdashboard.org:8000/summary/ Django has templates that will allow us to make this slick and pretty, but it's getting a little late for that tonight. I think we can whip up some quick visualizations of what's in the DB with a nice Web page with some concerted python hacking. For starters, it would be nice to have a version of the data whereby queries can actually complete in a reasonable time. :-) What's the best way to do this? Split the table by months? I will check what I have into the bismark source tree so that others can work on this. (I'm looking at Abhishek :-) -Nick ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] FCC app progress: django 2011-04-18 5:57 [Bismark-devel] FCC app progress: django Nick Feamster @ 2011-04-18 7:57 ` Nick Feamster 2011-04-18 12:18 ` Dave Taht 1 sibling, 0 replies; 13+ messages in thread From: Nick Feamster @ 2011-04-18 7:57 UTC (permalink / raw) To: Nick Feamster Cc: <hndr@lists.pixilab.org>, bismark-devel, Abhishek Jain Got the django-backed production server up and running at http://networkdashboard.org/ woot! we are ready to go. will check in to bismark svn first thing tomorrow. -Nick On Apr 18, 2011, at 1:57 AM, Nick Feamster wrote: > (sorry for list cross-posting) > > Srikanth, Abhishek, Walter, > > Small, slow progress on the FCC app--- > > I have a written a very simple server with django. I've got the django server hooked up to our bismark mysql database. It's basically a slick python wrapper for doing Web development with a database back-end. The setup is ugly right now, but it's a proof of concept, and it works (django is talking to our back-end). For example: > http://networkdashboard.org:8000/summary/ > > Django has templates that will allow us to make this slick and pretty, but it's getting a little late for that tonight. > > I think we can whip up some quick visualizations of what's in the DB with a nice Web page with some concerted python hacking. For starters, it would be nice to have a version of the data whereby queries can actually complete in a reasonable time. :-) What's the best way to do this? Split the table by months? > > I will check what I have into the bismark source tree so that others can work on this. (I'm looking at Abhishek :-) > > -Nick > _______________________________________________ > HNDR mailing list > HNDR@lists.pixilab.org > http://lists.pixilab.org/listinfo.cgi/hndr-pixilab.org ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] FCC app progress: django 2011-04-18 5:57 [Bismark-devel] FCC app progress: django Nick Feamster 2011-04-18 7:57 ` [Bismark-devel] [Hndr] " Nick Feamster @ 2011-04-18 12:18 ` Dave Taht 2011-04-18 12:46 ` [Bismark-devel] Dates are really tricky!! Dave Taht 1 sibling, 1 reply; 13+ messages in thread From: Dave Taht @ 2011-04-18 12:18 UTC (permalink / raw) To: hndr, bismark-devel, abhishekjain95 On 04/17/2011 11:57 PM, Nick Feamster wrote: > (sorry for list cross-posting) > > Srikanth, Abhishek, Walter, Taking walter and sri off the explicit cc list as both are already on bismark-devel. > Small, slow progress on the FCC app--- > > I have a written a very simple server with django. I've got the django server hooked up to our bismark mysql database. It's basically a slick python wrapper for doing Web development with a database back-end. The setup is ugly right now, but it's a proof of concept, and it works (django is talking to our back-end). For example: > http://networkdashboard.org:8000/summary/ > How we have configured the web servers here has had us survive several slashdottings. http://www.bufferbloat.net/projects/bloat/wiki/Dogfood_Principle Using fast cgi vs wsgi would probably lead to some security benefits and more predictable behavior, however it's a tossup. http://docs.djangoproject.com/en/dev/howto/deployment/fastcgi/ > Django has templates that will allow us to make this slick and pretty, but it's getting a little late for that tonight. > > I think we can whip up some quick visualizations of what's in the DB with a nice Web page with some concerted python hacking. For starters, it would be nice to have a version of the data whereby queries can actually complete in a reasonable time. :-) What's the best way to do this? Split the table by months? > Your mysql configuration was an out of the box default one designed for very small databases. Yours is quite large. Increasing several buffer sizes by several orders of magnitude would help a lot. Sri had made significant inroads into porting the database into postgres when I was there. Postgres is not only more highly performant and flexible than mysql, with a more capable parser, but has good analysis tools. It was my hope to benchmark some of your slowest existing queries using postgres's ANALYZE <query> tool to see how the design could be improved overall. I did look over one of the slower (30+ seconds!) queries and suggested that a between statement be used instead of an and for the date range, but we never got around to testing that and mysql used to not be able to do anything sane with a between range (postgres can). e.g: mysql> select dstport, sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat where tsstart>unix_timestamp('2011-2-6') and tsstart<unix_timestamp('2011-2-20') and deviceid='NB105' group by dstport order by down_bytes desc limit 20; MIGHT do better with: select dstport, sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat where tsstart between unix_timestamp('2011-2-6') and unix_timestamp('2011-2-20') and deviceid='NB105' group by dstport order by down_bytes desc limit 20; I'd not be huge on divvying up tables by month, but creating summary tables by day and by hour would be a good idea. Usage patterns tend to be self-similar across day of week and by hour of day. I note that it is important to be able to capture hour of day AT the location (EDT/MDT/PDT), as that is more self-similar that hour of day (UTC) So the above becomes a nightly cron job in a specialized summary table, something like (untested) drop table device_port_daily_summary; create table device_port_daily_summary as select deviceid, dstport, day(tsstart) as test_day, sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat group by deviceid, dstport, test_day (although it would be mildly better to do this incrementally, creating a primary key on the first 3 fields, and perhaps reversing the order of primary fields above. Depends on the statistics) > I will check what I have into the bismark source tree so that others can work on this. (I'm looking at Abhishek :-) > While not exactly allergic to svn, I am a git fan-boy. Even when working with svn these days I use git-svn to cope with it (offline git logs rule). I'm not asking you to change your scm backend, just sayin... ^ permalink raw reply [flat|nested] 13+ messages in thread
* [Bismark-devel] Dates are really tricky!! 2011-04-18 12:18 ` Dave Taht @ 2011-04-18 12:46 ` Dave Taht 2011-04-18 13:22 ` [Bismark-devel] [Hndr] " Marshini Chetty 2011-04-18 14:11 ` Nick Feamster 0 siblings, 2 replies; 13+ messages in thread From: Dave Taht @ 2011-04-18 12:46 UTC (permalink / raw) To: bismark-devel, hndr, abhishekjain95 On 04/18/2011 06:18 AM, Dave Taht wrote: > On 04/17/2011 11:57 PM, Nick Feamster wrote: > >> I think we can whip up some quick visualizations of what's in the DB >> with a nice Web page with some concerted python hacking. For >> starters, it would be nice to have a version of the data whereby >> queries can actually complete in a reasonable time. :-) What's the >> best way to do this? Split the table by months? >> > I did look over one of the slower (30+ seconds!) queries and suggested > that a between statement be used instead of an and for the date range, > but we never got around to testing that and mysql used to not be able > to do anything sane with a between range (postgres can). > > e.g: > > mysql> select dstport, sum(uppkts) as up_p, sum(dwpkts) as down_p, > sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from > FLOWS_newformat where tsstart>unix_timestamp('2011-2-6') and > tsstart<unix_timestamp('2011-2-20') and deviceid='NB105' group by > dstport order by down_bytes desc limit 20; > > MIGHT do better with: > > select dstport, sum(uppkts) as up_p, sum(dwpkts) as down_p, > sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from > FLOWS_newformat where tsstart between unix_timestamp('2011-2-6') and > unix_timestamp('2011-2-20') and deviceid='NB105' group by dstport > order by down_bytes desc limit 20; > > > I'd not be huge on divvying up tables by month, but creating summary > tables by day and by hour would be a good idea. Usage patterns tend to > be self-similar across day of week and by hour of day. > > I note that it is important to be able to capture hour of day AT the > location (EDT/MDT/PDT), as that is more self-similar that hour of day > (UTC) > To be clearer, what I suggest above is not solved by what I wrote below, and the below contained an error. Coping with dates can be really tricky and should not be undertaken before my first cup of coffee. http://www.postgresql.org/docs/8.2/static/datatype-datetime.html > So the above becomes a nightly cron job in a specialized summary > table, something like (untested) > > drop table device_port_daily_summary; > create table device_port_daily_summary as > select deviceid, dstport, day(tsstart) as test_day, EXTRACT(YEAR FROM TIMESTAMP tsstart) as test_year , sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat group by deviceid, dstport, test_day, test_year; The way described below has a day-range of 0-365, which wasn't what you wanted. Days since the epoch or the start of database time would probably be better than explicitly storing the year... but I don't remember the good way of doing that. Dates are tricky. > select deviceid, dstport, day(tsstart) as test_day, sum(uppkts) as > up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as > down_bytes from FLOWS_newformat group by deviceid, dstport, test_day would be wrong. ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] Dates are really tricky!! 2011-04-18 12:46 ` [Bismark-devel] Dates are really tricky!! Dave Taht @ 2011-04-18 13:22 ` Marshini Chetty 2011-04-18 14:11 ` Nick Feamster 1 sibling, 0 replies; 13+ messages in thread From: Marshini Chetty @ 2011-04-18 13:22 UTC (permalink / raw) To: Dave Taht; +Cc: hndr, bismark-devel, abhishekjain95 Hi all This is awesome. At this rate, getting something together for the FCC competition seems very doable. M. Sent from my iPhone On Apr 18, 2011, at 8:46 AM, Dave Taht <d@taht.net> wrote: > On 04/18/2011 06:18 AM, Dave Taht wrote: >> On 04/17/2011 11:57 PM, Nick Feamster wrote: >> >>> I think we can whip up some quick visualizations of what's in the DB with a nice Web page with some concerted python hacking. For starters, it would be nice to have a version of the data whereby queries can actually complete in a reasonable time. :-) What's the best way to do this? Split the table by months? >>> >> I did look over one of the slower (30+ seconds!) queries and suggested that a between statement be used instead of an and for the date range, but we never got around to testing that and mysql used to not be able to do anything sane with a between range (postgres can). >> >> e.g: >> >> mysql> select dstport, sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat where tsstart>unix_timestamp('2011-2-6') and tsstart<unix_timestamp('2011-2-20') and deviceid='NB105' group by dstport order by down_bytes desc limit 20; >> >> MIGHT do better with: >> >> select dstport, sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat where tsstart between unix_timestamp('2011-2-6') and unix_timestamp('2011-2-20') and deviceid='NB105' group by dstport order by down_bytes desc limit 20; >> >> >> I'd not be huge on divvying up tables by month, but creating summary tables by day and by hour would be a good idea. Usage patterns tend to be self-similar across day of week and by hour of day. >> >> I note that it is important to be able to capture hour of day AT the location (EDT/MDT/PDT), as that is more self-similar that hour of day (UTC) >> > To be clearer, what I suggest above is not solved by what I wrote below, and the below contained an error. > > Coping with dates can be really tricky and should not be undertaken before my first cup of coffee. > > http://www.postgresql.org/docs/8.2/static/datatype-datetime.html > >> So the above becomes a nightly cron job in a specialized summary table, something like (untested) >> >> drop table device_port_daily_summary; >> create table device_port_daily_summary as >> > select deviceid, dstport, day(tsstart) as test_day, EXTRACT(YEAR FROM TIMESTAMP tsstart) as test_year , sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat group by deviceid, dstport, test_day, test_year; > > The way described below has a day-range of 0-365, which wasn't what you wanted. Days since the epoch or the start of database time would probably be better than explicitly storing the year... but I don't remember the good way of doing that. > > Dates are tricky. > >> select deviceid, dstport, day(tsstart) as test_day, sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat group by deviceid, dstport, test_day > > would be wrong. > > _______________________________________________ > HNDR mailing list > HNDR@lists.pixilab.org > http://lists.pixilab.org/listinfo.cgi/hndr-pixilab.org ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] Dates are really tricky!! 2011-04-18 12:46 ` [Bismark-devel] Dates are really tricky!! Dave Taht 2011-04-18 13:22 ` [Bismark-devel] [Hndr] " Marshini Chetty @ 2011-04-18 14:11 ` Nick Feamster 2011-04-18 14:37 ` Srikanth Sundaresan 1 sibling, 1 reply; 13+ messages in thread From: Nick Feamster @ 2011-04-18 14:11 UTC (permalink / raw) To: Dave Taht; +Cc: hndr, bismark-devel, abhishekjain95 Dave, Django does allow native SQL, but the cool thing about it is that most queries can be done with Python methods, that essentially do introspection on the database tables. It's pretty slick. Switching from mysql to postgres (when we are ready) is a one-line change. I like the idea of generating summary tables per day. That would _really_ speed things up, I think, and most people probably are just looking at the most recent queries by default. Is this in the bug database yet? I'll be happy to file it. :-) Who is working on this part? -Nick On Apr 18, 2011, at 8:46 AM, Dave Taht wrote: > On 04/18/2011 06:18 AM, Dave Taht wrote: >> On 04/17/2011 11:57 PM, Nick Feamster wrote: >> >>> I think we can whip up some quick visualizations of what's in the DB with a nice Web page with some concerted python hacking. For starters, it would be nice to have a version of the data whereby queries can actually complete in a reasonable time. :-) What's the best way to do this? Split the table by months? >>> >> I did look over one of the slower (30+ seconds!) queries and suggested that a between statement be used instead of an and for the date range, but we never got around to testing that and mysql used to not be able to do anything sane with a between range (postgres can). >> >> e.g: >> >> mysql> select dstport, sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat where tsstart>unix_timestamp('2011-2-6') and tsstart<unix_timestamp('2011-2-20') and deviceid='NB105' group by dstport order by down_bytes desc limit 20; >> >> MIGHT do better with: >> >> select dstport, sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat where tsstart between unix_timestamp('2011-2-6') and unix_timestamp('2011-2-20') and deviceid='NB105' group by dstport order by down_bytes desc limit 20; >> >> >> I'd not be huge on divvying up tables by month, but creating summary tables by day and by hour would be a good idea. Usage patterns tend to be self-similar across day of week and by hour of day. >> >> I note that it is important to be able to capture hour of day AT the location (EDT/MDT/PDT), as that is more self-similar that hour of day (UTC) >> > To be clearer, what I suggest above is not solved by what I wrote below, and the below contained an error. > > Coping with dates can be really tricky and should not be undertaken before my first cup of coffee. > > http://www.postgresql.org/docs/8.2/static/datatype-datetime.html > >> So the above becomes a nightly cron job in a specialized summary table, something like (untested) >> >> drop table device_port_daily_summary; >> create table device_port_daily_summary as >> > select deviceid, dstport, day(tsstart) as test_day, EXTRACT(YEAR FROM TIMESTAMP tsstart) as test_year , sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat group by deviceid, dstport, test_day, test_year; > > The way described below has a day-range of 0-365, which wasn't what you wanted. Days since the epoch or the start of database time would probably be better than explicitly storing the year... but I don't remember the good way of doing that. > > Dates are tricky. > >> select deviceid, dstport, day(tsstart) as test_day, sum(uppkts) as up_p, sum(dwpkts) as down_p, sum(upbytes) as up_bytes, sum(dwbytes) as down_bytes from FLOWS_newformat group by deviceid, dstport, test_day > > would be wrong. > > _______________________________________________ > HNDR mailing list > HNDR@lists.pixilab.org > http://lists.pixilab.org/listinfo.cgi/hndr-pixilab.org ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] Dates are really tricky!! 2011-04-18 14:11 ` Nick Feamster @ 2011-04-18 14:37 ` Srikanth Sundaresan 2011-04-18 14:39 ` Nick Feamster 0 siblings, 1 reply; 13+ messages in thread From: Srikanth Sundaresan @ 2011-04-18 14:37 UTC (permalink / raw) To: Nick Feamster; +Cc: hndr, bismark-devel, abhishekjain95 On Apr 18, 2011, at 10:11 AM, Nick Feamster wrote: > I like the idea of generating summary tables per day. That would _really_ speed things up, I think, and most people probably are just looking at the most recent queries by default. Is this in the bug database yet? I'll be happy to file it. :-) Who is working on this part? Dave and I discussed this when he was visiting. I'm still not fully convinced that summary tables are the way to go unless we know exactly what we want. - Srikanth ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] Dates are really tricky!! 2011-04-18 14:37 ` Srikanth Sundaresan @ 2011-04-18 14:39 ` Nick Feamster 2011-04-18 14:42 ` Dave Taht 2011-04-18 14:58 ` Beki Grinter 0 siblings, 2 replies; 13+ messages in thread From: Nick Feamster @ 2011-04-18 14:39 UTC (permalink / raw) To: Srikanth Sundaresan; +Cc: hndr, bismark-devel, abhishekjain95 On Apr 18, 2011, at 10:37 AM, Srikanth Sundaresan wrote: > > On Apr 18, 2011, at 10:11 AM, Nick Feamster wrote: > >> I like the idea of generating summary tables per day. That would _really_ speed things up, I think, and most people probably are just looking at the most recent queries by default. Is this in the bug database yet? I'll be happy to file it. :-) Who is working on this part? > > Dave and I discussed this when he was visiting. I'm still not fully convinced that summary tables are the way to go unless we know exactly what we want. Cool. Let's discuss at tomorrow's meeting? It would be nice if we could do something that made the tables faster in one way or another (whether it means splitting by month, or by day). -Nick ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] Dates are really tricky!! 2011-04-18 14:39 ` Nick Feamster @ 2011-04-18 14:42 ` Dave Taht 2011-04-18 14:58 ` Beki Grinter 1 sibling, 0 replies; 13+ messages in thread From: Dave Taht @ 2011-04-18 14:42 UTC (permalink / raw) To: Nick Feamster; +Cc: hndr, bismark-devel, abhishekjain95 On 04/18/2011 08:39 AM, Nick Feamster wrote: > On Apr 18, 2011, at 10:37 AM, Srikanth Sundaresan wrote: > >> On Apr 18, 2011, at 10:11 AM, Nick Feamster wrote: >> >>> I like the idea of generating summary tables per day. That would _really_ speed things up, I think, and most people probably are just looking at the most recent queries by default. Is this in the bug database yet? I'll be happy to file it. :-) Who is working on this part? >> Dave and I discussed this when he was visiting. I'm still not fully convinced that summary tables are the way to go unless we know exactly what we want. Defining exactly what you want is a good idea. :) I do note that the usage pattern by timezone thing is rather important, and very hard to do unless that data is captured about the device(s). > Cool. Let's discuss at tomorrow's meeting? > I can dial in if desired. 12? > It would be nice if we could do something that made the tables faster in one way or another (whether it means splitting by month, or by day). > > -Nick ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] Dates are really tricky!! 2011-04-18 14:39 ` Nick Feamster 2011-04-18 14:42 ` Dave Taht @ 2011-04-18 14:58 ` Beki Grinter 2011-04-18 15:03 ` Nick Feamster 1 sibling, 1 reply; 13+ messages in thread From: Beki Grinter @ 2011-04-18 14:58 UTC (permalink / raw) To: Nick Feamster; +Cc: hndr, bismark-devel, abhishekjain95, Beki Grinter [-- Attachment #1: Type: text/plain, Size: 1372 bytes --] I think we cancelled tomorrow's meeting, I won't be there! But, I guess that does mean that others have the 12-1 slot back :) beki On Apr 18, 2011, at 10:39 AM, Nick Feamster wrote: > > On Apr 18, 2011, at 10:37 AM, Srikanth Sundaresan wrote: > >> >> On Apr 18, 2011, at 10:11 AM, Nick Feamster wrote: >> >>> I like the idea of generating summary tables per day. That would _really_ speed things up, I think, and most people probably are just looking at the most recent queries by default. Is this in the bug database yet? I'll be happy to file it. :-) Who is working on this part? >> >> Dave and I discussed this when he was visiting. I'm still not fully convinced that summary tables are the way to go unless we know exactly what we want. > > Cool. Let's discuss at tomorrow's meeting? > > It would be nice if we could do something that made the tables faster in one way or another (whether it means splitting by month, or by day). > > -Nick > _______________________________________________ > HNDR mailing list > HNDR@lists.pixilab.org > http://lists.pixilab.org/listinfo.cgi/hndr-pixilab.org --- Beki Grinter Associate Professor, School of Interactive Computing Georgia Institute of Technology http://www.cc.gatech.edu/~beki beki70.wordpress.com AIM, Skype, Twitter, FourSquare, Flickr, etc..: beki70 [-- Attachment #2: Type: text/html, Size: 20339 bytes --] ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] Dates are really tricky!! 2011-04-18 14:58 ` Beki Grinter @ 2011-04-18 15:03 ` Nick Feamster 2011-04-18 15:35 ` Marshini Chetty 0 siblings, 1 reply; 13+ messages in thread From: Nick Feamster @ 2011-04-18 15:03 UTC (permalink / raw) To: Beki Grinter; +Cc: hndr, bismark-devel, abhishekjain95 Oh yes... I would like to go to Marshini's defense lunch. Perhaps we should all go to that. Is it a conflict of interest for me to suggest that? :-) Maybe we can push the meeting into the afternoon? -Nick On Apr 18, 2011, at 10:58 AM, Beki Grinter wrote: > I think we cancelled tomorrow's meeting, I won't be there! But, I guess that does mean that others have the 12-1 slot back :) > > > beki > > On Apr 18, 2011, at 10:39 AM, Nick Feamster wrote: > >> >> On Apr 18, 2011, at 10:37 AM, Srikanth Sundaresan wrote: >> >>> >>> On Apr 18, 2011, at 10:11 AM, Nick Feamster wrote: >>> >>>> I like the idea of generating summary tables per day. That would _really_ speed things up, I think, and most people probably are just looking at the most recent queries by default. Is this in the bug database yet? I'll be happy to file it. :-) Who is working on this part? >>> >>> Dave and I discussed this when he was visiting. I'm still not fully convinced that summary tables are the way to go unless we know exactly what we want. >> >> Cool. Let's discuss at tomorrow's meeting? >> >> It would be nice if we could do something that made the tables faster in one way or another (whether it means splitting by month, or by day). >> >> -Nick >> _______________________________________________ >> HNDR mailing list >> HNDR@lists.pixilab.org >> http://lists.pixilab.org/listinfo.cgi/hndr-pixilab.org > > --- > Beki Grinter > Associate Professor, School of Interactive Computing > Georgia Institute of Technology > > http://www.cc.gatech.edu/~beki > beki70.wordpress.com > AIM, Skype, Twitter, FourSquare, Flickr, etc..: beki70 > > > > > > > ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] Dates are really tricky!! 2011-04-18 15:03 ` Nick Feamster @ 2011-04-18 15:35 ` Marshini Chetty 2011-04-18 16:02 ` Keith Edwards 0 siblings, 1 reply; 13+ messages in thread From: Marshini Chetty @ 2011-04-18 15:35 UTC (permalink / raw) To: Nick Feamster; +Cc: hndr, bismark-devel, abhishekjain95, Beki Grinter [-- Attachment #1: Type: text/plain, Size: 2270 bytes --] Hi all The lunch will be at Mid-city cafe at noon if anyone is interested in joining. I won't be able to make the afternoon meeting. M. On Mon, Apr 18, 2011 at 11:03 AM, Nick Feamster <feamster@cc.gatech.edu>wrote: > Oh yes... I would like to go to Marshini's defense lunch. Perhaps we > should all go to that. Is it a conflict of interest for me to suggest that? > :-) > > Maybe we can push the meeting into the afternoon? > > -Nick > > On Apr 18, 2011, at 10:58 AM, Beki Grinter wrote: > > > I think we cancelled tomorrow's meeting, I won't be there! But, I guess > that does mean that others have the 12-1 slot back :) > > > > > > beki > > > > On Apr 18, 2011, at 10:39 AM, Nick Feamster wrote: > > > >> > >> On Apr 18, 2011, at 10:37 AM, Srikanth Sundaresan wrote: > >> > >>> > >>> On Apr 18, 2011, at 10:11 AM, Nick Feamster wrote: > >>> > >>>> I like the idea of generating summary tables per day. That would > _really_ speed things up, I think, and most people probably are just looking > at the most recent queries by default. Is this in the bug database yet? > I'll be happy to file it. :-) Who is working on this part? > >>> > >>> Dave and I discussed this when he was visiting. I'm still not fully > convinced that summary tables are the way to go unless we know exactly what > we want. > >> > >> Cool. Let's discuss at tomorrow's meeting? > >> > >> It would be nice if we could do something that made the tables faster in > one way or another (whether it means splitting by month, or by day). > >> > >> -Nick > >> _______________________________________________ > >> HNDR mailing list > >> HNDR@lists.pixilab.org > >> http://lists.pixilab.org/listinfo.cgi/hndr-pixilab.org > > > > --- > > Beki Grinter > > Associate Professor, School of Interactive Computing > > Georgia Institute of Technology > > > > http://www.cc.gatech.edu/~beki > > beki70.wordpress.com > > AIM, Skype, Twitter, FourSquare, Flickr, etc..: beki70 > > > > > > > > > > > > > > > > _______________________________________________ > HNDR mailing list > HNDR@lists.pixilab.org > http://lists.pixilab.org/listinfo.cgi/hndr-pixilab.org > -- ----------------------- Marshini Chetty HCC PhD Candidate College of Computing Georgia Institute of Technology www.cc.gatech.edu/~marshini [-- Attachment #2: Type: text/html, Size: 3486 bytes --] ^ permalink raw reply [flat|nested] 13+ messages in thread
* Re: [Bismark-devel] [Hndr] Dates are really tricky!! 2011-04-18 15:35 ` Marshini Chetty @ 2011-04-18 16:02 ` Keith Edwards 0 siblings, 0 replies; 13+ messages in thread From: Keith Edwards @ 2011-04-18 16:02 UTC (permalink / raw) To: marshini; +Cc: hndr, bismark-devel, abhishekjain95 [-- Attachment #1: Type: text/plain, Size: 2704 bytes --] I'm booked all afternoon (including lunch), so won't be able to make the social outing or an afternoon unfortunately... -k On Apr 18, 2011, at 11:35 AM, Marshini Chetty wrote: > Hi all > > The lunch will be at Mid-city cafe at noon if anyone is interested in joining. I won't be able to make the afternoon meeting. > > M. > > On Mon, Apr 18, 2011 at 11:03 AM, Nick Feamster <feamster@cc.gatech.edu> wrote: > Oh yes... I would like to go to Marshini's defense lunch. Perhaps we should all go to that. Is it a conflict of interest for me to suggest that? :-) > > Maybe we can push the meeting into the afternoon? > > -Nick > > On Apr 18, 2011, at 10:58 AM, Beki Grinter wrote: > > > I think we cancelled tomorrow's meeting, I won't be there! But, I guess that does mean that others have the 12-1 slot back :) > > > > > > beki > > > > On Apr 18, 2011, at 10:39 AM, Nick Feamster wrote: > > > >> > >> On Apr 18, 2011, at 10:37 AM, Srikanth Sundaresan wrote: > >> > >>> > >>> On Apr 18, 2011, at 10:11 AM, Nick Feamster wrote: > >>> > >>>> I like the idea of generating summary tables per day. That would _really_ speed things up, I think, and most people probably are just looking at the most recent queries by default. Is this in the bug database yet? I'll be happy to file it. :-) Who is working on this part? > >>> > >>> Dave and I discussed this when he was visiting. I'm still not fully convinced that summary tables are the way to go unless we know exactly what we want. > >> > >> Cool. Let's discuss at tomorrow's meeting? > >> > >> It would be nice if we could do something that made the tables faster in one way or another (whether it means splitting by month, or by day). > >> > >> -Nick > >> _______________________________________________ > >> HNDR mailing list > >> HNDR@lists.pixilab.org > >> http://lists.pixilab.org/listinfo.cgi/hndr-pixilab.org > > > > --- > > Beki Grinter > > Associate Professor, School of Interactive Computing > > Georgia Institute of Technology > > > > http://www.cc.gatech.edu/~beki > > beki70.wordpress.com > > AIM, Skype, Twitter, FourSquare, Flickr, etc..: beki70 > > > > > > > > > > > > > > > > _______________________________________________ > HNDR mailing list > HNDR@lists.pixilab.org > http://lists.pixilab.org/listinfo.cgi/hndr-pixilab.org > > > > -- > ----------------------- > Marshini Chetty > HCC PhD Candidate > College of Computing > Georgia Institute of Technology > www.cc.gatech.edu/~marshini > _______________________________________________ > HNDR mailing list > HNDR@lists.pixilab.org > http://lists.pixilab.org/listinfo.cgi/hndr-pixilab.org [-- Attachment #2: Type: text/html, Size: 4075 bytes --] ^ permalink raw reply [flat|nested] 13+ messages in thread
end of thread, other threads:[~2011-04-18 16:02 UTC | newest] Thread overview: 13+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2011-04-18 5:57 [Bismark-devel] FCC app progress: django Nick Feamster 2011-04-18 7:57 ` [Bismark-devel] [Hndr] " Nick Feamster 2011-04-18 12:18 ` Dave Taht 2011-04-18 12:46 ` [Bismark-devel] Dates are really tricky!! Dave Taht 2011-04-18 13:22 ` [Bismark-devel] [Hndr] " Marshini Chetty 2011-04-18 14:11 ` Nick Feamster 2011-04-18 14:37 ` Srikanth Sundaresan 2011-04-18 14:39 ` Nick Feamster 2011-04-18 14:42 ` Dave Taht 2011-04-18 14:58 ` Beki Grinter 2011-04-18 15:03 ` Nick Feamster 2011-04-18 15:35 ` Marshini Chetty 2011-04-18 16:02 ` Keith Edwards
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox