1.47 00:36:12 increased default buffer and downgraded some messages to info level
2004/10/27 mbalazin - Added support for blocking style failure recovery
- Changed trimming of undo buffers
- other small changes.
2004/10/25 mbalazin Bug fix in datapath... there was a possibility of bug under high data rates.
Jeong-Hyon, I'm not changing the HA stuff because I assume we'll revisit it
anyways and integrate it with connection points, etc.
2004/10/25 mbalazin Making the DataPath slow down if downstream nodes cannot keep up.
2004/10/22 mbalazin - SUnion and SOutput now both inherit from an SControlQBox that holds all
the common stuff for boxes with an output control stream
- ConsistencyMngr now listens for inputs from both types of control streams.
- SOutput signals when reconciliation is completed (instead of SUnion)
- Also bug fix when suspending data path.. cannot suspend it completely
or control messages don't get through
2004/10/22 mbalazin Starting to have Borealis nodes collaborate to handle clients while reconciling their states.
2004/09/27 mbalazin Added a ConsistencyMngr class to the QueryProcessor. This class manages the consistency of the state of the query network in case of failures and network partitions. If you don't care about any of this, you should not see any difference. Nothing happens unless a query network uses an sunion operator.
2004/09/24 yna Moved most of the Aurora code into the Borealis namespace. There are still a few things in util/ that aren't
used that need to be moved.....
2004/09/20 mbalazin - Fixed race condition in AuroraNode.
Race was between: unsubscribing and deleting a stream (because
unsubscribe gets scheduled and executed sometime later).
- Modified "subscribe" for consistency between sub/unsub.
- Adjusted DataPath because no workaround needed anymore
2004/08/26 mbalazin Updated stream management:
- One can now subscribe to input streams. Even when no query network uses the stream.
- Moving subsets of boxes that depend on one another works (streams get forwarded correctly). Not all cominations, though.
- Updated our computations of query hunks that depend on streams. Consolidated that in query setup and deletion.
Removed stale concept of streams being "owned"... using their location instead.
Other small clean ups.
2004/08/24 mbalazin Making Anurag happy ;-) ... removed duplicate class Stream.
Most of what used to be in Borealis::Stream is now in Borealis::StreamState
The tuple buffer is now in a new class called queryProcessor/StreamBuffer/
This required updates in QueryProcessor and DataPath
Also, in DataPath, renamed all m_input_streams into m_input_paths
and m_output_streams into m_output_paths. That way, when we talk about
these streams, we will distinguish the inputs and output of query hunks
(or superoperators) and the inputs and outputs of a node. Adjusted
a few method names as well.
2004/08/12 yna Fixed box state movement, and internal box movement.
2004/06/25 mbalazin Removing outgoing data paths when removing streams and queries so when we move something back, we don't have duplicate outgoing datapaths anymore
2004/06/07 mbalazin Propagating changes from demo branch into main trunk.
2004/06/03 jhhwang branches: 1.33.2;
Addition of text outputs
Shouldn't do cvs up
2004/06/03 jhhwang (1) updates of the GUI so that we can see the end-to-end delays
(2) changes to simple.cc so that it sends the delay
(3) reduced the size of the send buffer in order to fill the buffer quickly
(4) not yet solved the passive standby problem.
2004/06/03 mbalazin Small things... committing to synch.
2004/06/03 mbalazin Added trimming of output queues but something strange is going on when we recovery... I need to investigate
2004/06/03 jhhwang Now the secondaries updates themselves based on checkpoint messages. Still need to work on queue trimming on backups (i.e, void update(StreamID stream_id, string last_tuple))
2004/06/03 mbalazin last_input_tuples()
and last_output_tuples()
2004/06/02 jhhwang Updates for passive standby. Needs more work yet.
2004/06/02 mbalazin Sending stream events after they were checkpointed
2004/06/02 mbalazin Modifying the we we're going to send history after checkpoints
2004/06/02 mbalazin Parameters for checkpoint messages
2004/06/02 jhhwang Minor fixes
2004/06/02 mbalazin - Added checkpoint messages to secondary
- Bug fix in send_history -> there was an infinite loop due to brackets
- Bug fix in buffer_as_event -> was not handling the case where nothing was yet buffered
2004/06/02 jhhwang changes for passive standby
2004/05/31 mbalazin ok. disabling ha completely when doing NO_HA, but NO_HA should not be the default then.
2004/05/31 mbalazin Decoupling such that QueryProcessor/DataPath do not invoke methods directly on the HA module but rather send the HA module a message on its input queue.
I agree that this is extra overhead but this is the current architecture.
Given the tight coupling between DataPath, QueryProcessor, and HA we should probably put all these three classes in a single module under a single BasicComponent.
This code is not tested but it compiles... I'm going to test it now
2004/05/29 jhhwang minor fixes
plan to work on queue trimming, then duplicate elimination.
2004/05/29 jhhwang Not a big deal.
2004/05/29 mbalazin Just log messages
2004/05/29 mbalazin Just a precaution to avoid possible race conditions in the network partitions demo
2004/05/28 mbalazin Just a small fix... let me know if it causes you any conflicts...
2004/05/28 mbalazin Yet another bug fix... this time for network partitions. When we switch between replicas, we need to update all definitions first and then we should check what was the last tuple that we received. That way, if we had some tuples waiting to be enqueued either they go through and we update the definition later or we update the definition first and then we drop them.
2004/05/28 mbalazin Found the bug! It was so stupid... I had a lock and I was trying to aquire it again so I was pretty much deadlocking... and all that because of a stupid log message that I wanted to produce... it's fixed now!
2004/05/26 mbalazin Got duplicate elimination to work!
2004/05/25 mbalazin - bug fix: class StreamID operator != (== was working but != was not)
- added an option to disable queue trimming ("no-trim")
- a node drops input tuples if they come as a wrong version
2004/05/25 mbalazin - Modified subscriptions so they can specify the first history tuple that a clients desires.
- Adjusted stream buffering accordingly
2004/05/25 mbalazin Upstream backup simple version with ACK0 and ACK1
2004/05/24 mbalazin Avoid trying to find a replica when none exists
2004/05/24 mbalazin StreamEvents now contain StreamIDs in addition to stream names
2004/05/21 mbalazin ok. found the bug. Now it is possible to subscribe either asking for history or not asking for history.
-> load management demo: we don't send any history because that would create load spikes and make the demo harder to understand
-> network partitions demo: we do send the history
-> pure ha demo: we don't yet send the history. I have to modify the recovery so it asks for history
2004/05/21 mbalazin Option to get history or not is not quite working... committing to synch laptops
2004/05/21 mbalazin Allowing clients to subscribe with the option to get the history replay or not
2004/05/21 mbalazin We've got simple Rollback recovery!
- Basic HA demo now shows the simplest form of upstream backup
- Network partitions are handled by hot-swapping upstream node for another replica and by replaying history (no tuple loss unless going too fast for buffer size of course)
2004/05/14 mbalazin - Removed the slow data path completely
- Merged AuroraQueryProcessor with QueryProcessor since the latter was
mainly taking care of the slow data path
- Renamed AuroraGateway to DataPath because it is more accurate
- Got rid of SimpleReader, SimpleWriter, and SimpleAdmin because
they were using the slow datapath
2004/06/07 mbalazin - Just downgrading some log messages
- Increased ha interval to 150msec
2004/06/06 mbalazin A few bug fixes:
- In Stream, it is possible that begin=end=next and buffer is empty so need to distinguish (passive standby is great at creating plenty of corner cases)
- In DataPath, when secondary takes over in passive standby, it must send history from beginning of buffer to first tuple in set of tuples currently being send (not last as I had before...)
- A few other corner small fixes in Stream
2004/06/06 mbalazin Nodes do not send anymore empty checkpoint messages or queue trimming messages.
HA demo can now run using either a stateless or a stateful query
2004/06/04 mbalazin Passive standby now works for multiple downstream nodes failing/recovery independently.
2004/06/04 mbalazin Passive standby v1.0 working!
2004/06/04 jhhwang Very small changes
2004/06/04 jhhwang The Stream class seems working fine.
