1.35 15:02:46 Modified src for load_box.
2004/10/22 mbalazin Commenting out all usage of "add_responsability" to catalog and "remove_responsability" from catalog because:
- we are not using these responsabilities at the moment. We used to use it for HA but now primary/secondary talk directly to each other.
- there is a bug that needs fixing: when we send queries as our
responsabilities, we including the state of all boxes and queues states. We
shouldn't do this, but more importantly, it fails for some reason (thanks to Alex for pointing this out).
2004/10/21 yna Added load_box function, to dynamically load box code.
2004/10/21 mbalazin Just downgraded some messages from WARN to INFO or DEBUG
2004/09/24 yna Moved most of the Aurora code into the Borealis namespace. There are still a few things in util/ that aren't
used that need to be moved.....
2004/09/14 alexr Added the use of StatsMgr to the scheduler.
The statistics are being declared and used, but scheduler is not yet
collecting them at proper intervals.
Also fixed the usleep to actually utilize CPU for a box_cost
(Yanif, take note -- I will try to test this soon see if it helped)
Stats in StatisticsTools was renamed to SStats pending the namespace
reconciliation which needs to be negotiated with a few people.
2004/09/10 mbalazin When we move subscriptions automatically, we should check if destination
is self. Then we don't need to do anything.
Also modified the subscription method to return the set of successful subscriptions.
2004/08/27 mbalazin Clean-up in Admin:
- fixed a blocking call to be non-blocking in split_query
- now properly removing queries from pending once they are setup locally
(pending queries are only those in the process of being setup)
- streamlined moving load in move_load_XX. Steps still happen in series but at least now we respond to our client at the right moment.
Admin and QueryProcessor:
- added a method that changes the status of a set of queries in
on operation. That way when we move a set of queries, we delete all of
them from local query processor before checking dependencies.
2004/08/26 mbalazin Updated stream management:
- One can now subscribe to input streams. Even when no query network uses the stream.
- Moving subsets of boxes that depend on one another works (streams get forwarded correctly). Not all cominations, though.
- Updated our computations of query hunks that depend on streams. Consolidated that in query setup and deletion.
Removed stale concept of streams being "owned"... using their location instead.
Other small clean ups.
2004/08/24 anurag create_cp comments more verbose
2004/08/20 mbalazin Added utility class that automatically handles a bunch of remote tasks that should be processed in parallel. Provides a hook for a clean-up method.
Applied this utility to speed-up creation of connection points.
2004/08/19 mbalazin - Added a missing include in QOSOptimizer.h (for RPCs)
Bunch of changes mostly for connection points:
- Made CPViewDescriptions be Objects and use Name as unique id (instead of string
so that caused a few method signatures to change)
- Decoupled CPViewDescriptions from Stream
- My class Stream will go away in the meantime, I renamed the files to be MStream.* to avoid confusion in includes
- Connection points are now registered in the catalog.
2004/08/18 mbalazin Made calls to create_cp asynch
Some changes in control flow (all the steps remain they just happen in different order)
Changed create_cp stub in QP to pretend that creation succeeded.
2004/08/18 anurag creating cpviews being added (slowly)
2004/08/12 yna Fixed box state movement, and internal box movement.
2004/07/17 alexr
fixed some minor bugs
worked around empty box state problem
fixed up box-removing flow control
2004/07/17 yna Added QueryProcessor::resume_queries to resume choked inputs. This is now part of the move_load process.
Added chokeSubNetwork, resumeSubNetwork, drainSubNetwork virtual functions to Scheduler. Added placeholder for drainSubNetwork prior to packing boxes.
2004/07/16 yna Admin::move_load is now a 5 (!!) stage process. Admin::move_load_2 now chokes off inputs to boxes, prior to packing them. New chokeBoxes method call defined in AuroraNode, to notify scheduler to perform cut off, and buffer.
2004/06/29 yna Added fine-grained box movement, through split_query and merge_query in Admin.
Updated movebox_test to split query into single boxes, move the boxes, and then merge boxes back into one hunk at the destination.
Added batch queue deserialization.
2004/06/25 mbalazin - When moving load, packing the state of the queries that are moved is performed in on non blocking operation
- Changed some of the RPC methods in QueryProcessor to take a copy of the query in parameter.
2004/06/24 yna Modified movebox process to remove boxes at end of transaction. Added query hunk instantiation from serialized state (queue serialization only for now).
2004/06/22 yna Simple movebox implementation. Moves query hunks, but not boxes or state. Added demo, movebox_test.
2004/06/01 mbalazin Bug fix: When we select the node from which we are supposed to get our input stream, in case there are multiple possibilities, I was assuming that the first one that was registered in the calatog should be considered the primary.
There are conditions, though when the replica gets to the catalog first. Therefore, because we currently do not label the stream from the primary with the correct version name, I'm using a comparison on the port number of the node that is producing the stream. The node with the smallest port number is considered to be the primary.
2004/05/28 mbalazin Bug fix... race condition when updating catalog asynchronously so changed it to be synchronous... there's still another problem, though.
2004/05/28 mbalazin Bug fix. Now that we are setting up the replicas up front, we have 2 versions of all streams and queries in the catalog. For subscriptions, we therefore should pick the first matching (as the others are the replicas that nevertheless have the same name)
2004/05/28 mbalazin - Replicas are now setup and created up front rather than after failure.
- Moved the RecoveryType enumeration into common/Recovery.h because both the QueryProcessor and Admin need to use that data structure.
- Changed the names of streams in the query to be shorter
2004/05/20 mbalazin Updated query processor to support hot-swapping of input stream replicas
Updates HA module to keep track of available replicas
2004/05/20 mbalazin - Not using names for versions just unique IDs
- Prepared client to setup a query with a replica
2004/05/20 mbalazin Added support for connection points and connection point versions.
- catalog
- subscriptions
- admin awareness
Of course, the QP doesn't know about these versions at the moment
2004/05/19 mbalazin - Added a Java text front-end to HA demo application
- Starting to add support for connection points
2004/05/18 mbalazin just some logging tweaks
2004/05/18 mbalazin Just a log message change
2004/05/06 mbalazin - Added observable/observer pattern for HA module to monitor all input streams through the Admin module
- Primary adds the owners of these input streams to its list of primaries
2004/04/19 mbalazin Changed API of move_load method to take a vector rather than a vector as parameter
2004/04/14 mbalazin New dir structure
