1.41 16:50:32 Moved Registry.cc to AuroraNode.cc
2004/11/03 alexr Tentative measurement of input rates has been added under the name of
"InputRate"
Specified per box (and works for the port 0 only at the moment) and is
defined in tuples/second.
2004/11/02 alexr
New statistics fix (proper queue lengths are now recorded)
A limit on how many tuples at once a box will processed has been placed
(and set in common.h by a constant TUPLE_PROCESSING_LIMIT)
suspendSubnetwork call added that will merely remove boxes from active
execution but provides no buffering or listener suspention.
Please note the TUPLE_PROCESSING_LIMIT, as it might change the behavior
of your tests. (current implementation limits sum of tuples from all inputs
rather than each input port).
2004/11/01 bb Separeted table processing from AuroraNode.
2004/11/01 alexr Small fixes in stats collection (still not perfectly clean, but better).
Added queue length collection under the name of QLength stat. Nesime, stop
by tomorrow to talk about it...
2004/10/27 essie removed CPoint object and all references to it. CPoint was the old representation of Connection points. Now objects to represent connection points are CP and CPView.
2004/10/26 alexr
Statistics collection is finally functional. Scheduler collects per-box
cost as specified in the creation parameters of Stats object in AuroraNode
Nesime (and whoever else plans on using the stats), ask me if you want to
know how to use it.
Selectivity stats maintenance is on the way.
Note that records are not being removed when a box moves, so it will collect
0-s while away.
2004/10/23 mbalazin Modified checkpoint() method to re-use BoxPackage.
Making join and the consistency manager log some measurements
2004/10/21 yna Added load_box function, to dynamically load box code.
2004/10/21 anurag When creating CPView for input queues to boxes, the boxes are now told of the CPView on their input queue. The pointer in the box is null if no CPView exists in the input queue (because it is not set).
2004/10/19 tatbul Aurora sets timestamp field if only it is 0 (i.e., when tuple is first
received). Local timestamp is reset at all nodes.
2004/10/12 mbalazin output messages downgraded to DEBUG
2004/10/08 mbalazin Swapped 2 lines for extra safety (delete from scheduler before erasing from _boxes)
2004/10/08 mbalazin Bug fix in Pseudoscheduler:
- added removeFromSchedule method that ensures all boxes are removed from
_boxes_to_run and from _ext_boxes_to_run before we erase them. Otherwise,
scheduler runs boxes that were already destructed.
2004/10/08 yna Changed box packing interface to use smart pointers.
Updated any existing boxes that packs states.
2004/10/07 alexr
Several bug fixes.
QueueListners are now properly changed from input listeners to internal
listeners and vice-versa. That should be the proper rewrite replacing
Magda's fix (Magda, thank you for the quick fix! :)
A subtle bug with scheduler not waking up occasionally should be fixed now.
As far as I understand it was an interesting combination of two different
bugs, where each could cause similar behavior involving a non-waking up
scheduler.
Please report to me if scheduler fails to wake up during your runs. This
bug was somewhat non-determenistic and difficult to observe.
2004/10/05 mbalazin - Checkpoint and recovery for SUnion (local only)
- Reconciling state with checkpoint and recovery first version (supports all operators that know how to save their state).
2004/10/05 mbalazin - Checkpointing state of Join operators.
- Doing checkpoint/redo to reconcile state of joins when necessary.
- Added a void unpackQueue(const QueueState& packed_queue); method to QBox.
2004/09/30 yna Added TableDescription object to represent tables in Borealis.
bdb tables can now be added to the queryProcessor.
2004/09/24 yna Moved most of the Aurora code into the Borealis namespace. There are still a few things in util/ that aren't
used that need to be moved.....
2004/09/20 mbalazin - Fixed race condition in AuroraNode.
Race was between: unsubscribing and deleting a stream (because
unsubscribe gets scheduled and executed sometime later).
- Modified "subscribe" for consistency between sub/unsub.
- Adjusted DataPath because no workaround needed anymore
2004/09/14 anurag create_cpview does not need to return anything
and other fixes
2004/09/14 alexr Added the use of StatsMgr to the scheduler.
The statistics are being declared and used, but scheduler is not yet
collecting them at proper intervals.
Also fixed the usleep to actually utilize CPU for a box_cost
(Yanif, take note -- I will try to test this soon see if it helped)
Stats in StatisticsTools was renamed to SStats pending the namespace
reconciliation which needs to be negotiated with a few people.
2004/08/26 mbalazin Updated stream management:
- One can now subscribe to input streams. Even when no query network uses the stream.
- Moving subsets of boxes that depend on one another works (streams get forwarded correctly). Not all cominations, though.
- Updated our computations of query hunks that depend on streams. Consolidated that in query setup and deletion.
Removed stale concept of streams being "owned"... using their location instead.
Other small clean ups.
2004/08/24 anurag AuroraNode: added create_cpview method to create cp and views
Stream: stream knows about the cp that's on it
2004/08/21 yna Updated stream management to cleanly move boxes (no more intermediate streams being left everywhere).
Fixed bug in adding duplicate schemas from QueryProcessor to AuroraNode.
2004/08/12 yna Fixed box state movement, and internal box movement.
2004/08/10 anurag uncommented box moving code
2004/07/18 alexr
drainSubNetwork now works (still disabled by default).
chokeSubNetwork works much better with border cases being taken care of.
TupleQueueListeners are now disabled/enabled properly.
A few subtle bugs fixed.
2004/07/17 alexr
fixed some minor bugs
worked around empty box state problem
fixed up box-removing flow control
2004/07/17 yna Added QueryProcessor::resume_queries to resume choked inputs. This is now part of the move_load process.
Added chokeSubNetwork, resumeSubNetwork, drainSubNetwork virtual functions to Scheduler. Added placeholder for drainSubNetwork prior to packing boxes.
2004/07/16 yna Admin::move_load is now a 5 (!!) stage process. Admin::move_load_2 now chokes off inputs to boxes, prior to packing them. New chokeBoxes method call defined in AuroraNode, to notify scheduler to perform cut off, and buffer.
2004/07/07 yna Fixed abstract box packing stuff.
2004/06/30 yna Fixed scheduler's removeBoxes, fixed TupleQueueListener's notify method to use try_lock, working movebox_test demo.
2004/06/28 yna Queue serialization bug fix. Also, added stateful queue deserialization, for faster batch queue deserialization.
2004/06/25 mbalazin Removing outgoing data paths when removing streams and queries so when we move something back, we don't have duplicate outgoing datapaths anymore
2004/06/24 yna Modified movebox process to remove boxes at end of transaction. Added query hunk instantiation from serialized state (queue serialization only for now).
2004/06/22 yna Simple movebox implementation. Moves query hunks, but not boxes or state. Added demo, movebox_test.
2004/06/16 yna Added preliminary remove box code.
2004/04/22 mbalazin Crazy bug in AuroraNode.h:
- a library was being loaded with a hard-coded name
2004/04/14 mbalazin New dir structure
