controller.git
9 years agoBUG-2673: Introduced new more low-level DOM Data Change APIs 42/14542/8
Robert Varga [Tue, 27 Jan 2015 14:05:38 +0000 (15:05 +0100)]
BUG-2673: Introduced new more low-level DOM Data Change APIs

As it turned out abstraction provided by Helium Data Change
API was CPU costly and calculated lot of unnecessary data,
and did not provide necessary navigation for some use-cases.

This new API contract defines more low-level data change
APIs, where application is more in control, how it will
process / consume / decompose Data Change by providing
DataTreeCandidate.

Change-Id: I468c9583c7999bc02101a18a8adf5dc1a084f1d9
Signed-off-by: Tony Tkacik <ttkacik@cisco.com>
Signed-off-by: Robert Varga <rovarga@cisco.com>
9 years agoMerge "BUG-2627: do not duplicate descriptions"
Tony Tkacik [Thu, 12 Feb 2015 12:18:47 +0000 (12:18 +0000)]
Merge "BUG-2627: do not duplicate descriptions"

9 years agoMerge "BUG-2627: JMX interfaces need to be public"
Tony Tkacik [Thu, 12 Feb 2015 12:18:10 +0000 (12:18 +0000)]
Merge "BUG-2627: JMX interfaces need to be public"

9 years agoBUG-2627: do not duplicate descriptions 93/15193/1
Robert Varga [Thu, 12 Feb 2015 10:36:08 +0000 (11:36 +0100)]
BUG-2627: do not duplicate descriptions

This class effectively creates a repeateable annotation. Unfortunately
in Java 8, we get twice as many annotations, which leads to duplicate
entries. Instantiate an intermediate Set, so we suppress potential
duplicates.

Change-Id: I0377d439260c2b3793c972c73373f5f6c6a7f119
Signed-off-by: Robert Varga <rovarga@cisco.com>
9 years agoBUG-2627: JMX interfaces need to be public 92/15192/1
Robert Varga [Thu, 12 Feb 2015 10:18:32 +0000 (11:18 +0100)]
BUG-2627: JMX interfaces need to be public

Java 8 enforces the specification's required for MXBean interfaces to be
public. The mock interfaces were not public, hence were failing the test
automatically.

Change-Id: I4a358ff750da6c91571847b650ef0746e9da3621
Signed-off-by: Robert Varga <rovarga@cisco.com>
9 years agoMerge "Initial heartbeats not sent by Leader"
Moiz Raja [Thu, 12 Feb 2015 03:45:37 +0000 (03:45 +0000)]
Merge "Initial heartbeats not sent by Leader"

9 years agoMerge topic 'bug/2676'
Tom Pantelis [Wed, 11 Feb 2015 22:00:53 +0000 (22:00 +0000)]
Merge topic 'bug/2676'

* changes:
  Store the datastore type in dataStoreContext
  Refactor DataStoreContext
  BUG 2676 : Apply backpressure when creating transactions

9 years agoMerge "Run SingleFeatureTest on features/netconf"
Tony Tkacik [Wed, 11 Feb 2015 21:06:51 +0000 (21:06 +0000)]
Merge "Run SingleFeatureTest on features/netconf"

9 years agoAdd a diagnostic message to figure out why test fails 61/15161/1
Moiz Raja [Wed, 11 Feb 2015 19:53:08 +0000 (11:53 -0800)]
Add a diagnostic message to figure out why test fails

Adding a message to figure out why testFakeSnapshotsForLeaderWithInInitiateSnapshots
fails sometimes

Change-Id: I5c6f7d33e429a7497fa28ad99c316be2def59422
Signed-off-by: Moiz Raja <moraja@cisco.com>
9 years agoStore the datastore type in dataStoreContext 47/14947/9
Moiz Raja [Thu, 5 Feb 2015 23:38:38 +0000 (15:38 -0800)]
Store the datastore type in dataStoreContext

This way we do not need to pass it to DistributedDataStoreFactory,
DistributedDataStore and ShardManager as it is already present in
dataStoreContext

Change-Id: Id9aa1541728f3632a46d67f3bdbacb87fd39783f
Signed-off-by: Moiz Raja <moraja@cisco.com>
9 years agoRefactor DataStoreContext 36/14936/10
Moiz Raja [Thu, 5 Feb 2015 19:58:06 +0000 (11:58 -0800)]
Refactor DataStoreContext

It was getting difficult to maintain because we had the same field defined
in the Builder and the DatastoreContext and we were passing the fields along
using the DatastoreContext constructor. This meant that every new setting that
we added required multiple changes to be made to DatastoreContext.

Refactored for the Builder to create the DatastoreContext upfront and directly set
it's fields.

Change-Id: I8060c4ea3dfd02a5cac20e28fb5be2f26b1e1dbd
Signed-off-by: Moiz Raja <moraja@cisco.com>
9 years agoBUG 2676 : Apply backpressure when creating transactions 70/14870/11
Moiz Raja [Thu, 5 Feb 2015 02:19:14 +0000 (18:19 -0800)]
BUG 2676 : Apply backpressure when creating transactions

This patch uses a rate limiter to limit the number of write transactions
that can be created on the datastore at any given point of time (within a
second).

We also have added a metric that is trackable using JMX which will show
exactly how much time we take in committing a transaction.

Could this rate limiter have been on the DataBroker? Yes it could have been
but I think we need to go granular on this one. Ideally the ratelimiter would
be for every shard transaction but it's not trivial to do in a way that would
actually block the consumer for now - this is because creating a transaction on
Shard itself is an async operation.

Change-Id: I3d8e3baeb892ba494c0ab0d13a0d6226c1516511
Signed-off-by: Moiz Raja <moraja@cisco.com>
9 years agoRun SingleFeatureTest on features/netconf 54/15154/1
Ed Warnicke [Wed, 11 Feb 2015 16:59:15 +0000 (09:59 -0700)]
Run SingleFeatureTest on features/netconf

Change-Id: Ibc60948413f633b4954ff603ad6a951658a95132
Signed-off-by: Ed Warnicke <eaw@cisco.com>
9 years agoBug 2701: Fixed dependencies for features-netconf. 24/15124/2
Hideyuki Tai [Wed, 11 Feb 2015 00:35:54 +0000 (19:35 -0500)]
Bug 2701: Fixed dependencies for features-netconf.

Change-Id: I2b853145cbcd9a24b6cc029ab4d61d34a32a3dfe
Signed-off-by: Hideyuki Tai <Hideyuki.Tai@necam.com>
9 years agoMerge "Bug 2669: Use slf4j Logger instead of akka LoggingAdapter"
Moiz Raja [Tue, 10 Feb 2015 22:11:40 +0000 (22:11 +0000)]
Merge "Bug 2669: Use slf4j Logger instead of akka LoggingAdapter"

9 years agoMerge "BUG-2679 Workaround for wrong nagasena encode/decode with reused transmogrifier"
Tony Tkacik [Tue, 10 Feb 2015 21:13:46 +0000 (21:13 +0000)]
Merge "BUG-2679 Workaround for wrong nagasena encode/decode with reused transmogrifier"

9 years agoMerge "BUG-2310 - widen yang model for netconf-node."
Tony Tkacik [Tue, 10 Feb 2015 21:13:18 +0000 (21:13 +0000)]
Merge "BUG-2310 - widen yang model for netconf-node."

9 years agoMerge "BUG-2599 Netconf notification manager initial API and Impl"
Tony Tkacik [Tue, 10 Feb 2015 21:06:39 +0000 (21:06 +0000)]
Merge "BUG-2599 Netconf notification manager initial API and Impl"

9 years agoMerge "Fix missing log argument"
Tony Tkacik [Tue, 10 Feb 2015 21:06:08 +0000 (21:06 +0000)]
Merge "Fix missing log argument"

9 years agoMerge "Standardize on pax-exam 4.4.0"
Tony Tkacik [Tue, 10 Feb 2015 21:01:48 +0000 (21:01 +0000)]
Merge "Standardize on pax-exam 4.4.0"

9 years agoMerge "BUG-2288: implement DOMNotificationRouter"
Tony Tkacik [Tue, 10 Feb 2015 21:01:02 +0000 (21:01 +0000)]
Merge "BUG-2288: implement DOMNotificationRouter"

9 years agoMerge "BUG-2627: Fix ambiguous lookup in test case"
Tony Tkacik [Tue, 10 Feb 2015 21:00:19 +0000 (21:00 +0000)]
Merge "BUG-2627: Fix ambiguous lookup in test case"

9 years agoMerge "Bug-2692:Avoid fake snapshot during initiate snapshot"
Tom Pantelis [Tue, 10 Feb 2015 18:22:52 +0000 (18:22 +0000)]
Merge "Bug-2692:Avoid fake snapshot during initiate snapshot"

9 years agoBUG-2627: Fix ambiguous lookup in test case 03/15103/4
Robert Varga [Tue, 10 Feb 2015 09:11:23 +0000 (10:11 +0100)]
BUG-2627: Fix ambiguous lookup in test case

Looking up by java name "stream" matches two potential beans, which
means that the returned value depends on underlying collections. This
breaks when upgrading to Java 8, for example.

Fix by performing an explicit prefix name, which returns the right bean
everytime.

Change-Id: I4c7f7f26bc00cc1b03b9ea99ef84004da46c3caa
Signed-off-by: Robert Varga <rovarga@cisco.com>
9 years agoMerge "Optimize install snapshot, by making a call at end of installsnapshotreply"
Tom Pantelis [Tue, 10 Feb 2015 06:27:41 +0000 (06:27 +0000)]
Merge "Optimize install snapshot, by making a call at end of installsnapshotreply"

9 years agoMerge "Add Distributed DataStore as a dependency of the Simulator"
Tom Pantelis [Tue, 10 Feb 2015 04:44:04 +0000 (04:44 +0000)]
Merge "Add Distributed DataStore as a dependency of the Simulator"

9 years agoMerge "Optimized AppendEntries sending to follower by adding AppendEntry call at...
Tom Pantelis [Tue, 10 Feb 2015 04:43:21 +0000 (04:43 +0000)]
Merge "Optimized AppendEntries sending to follower by adding AppendEntry call at end of reply, if needed."

9 years agoMerge "Add signature marker and version to NormalizedNode streaming"
Moiz Raja [Tue, 10 Feb 2015 01:43:11 +0000 (01:43 +0000)]
Merge "Add signature marker and version to NormalizedNode streaming"

9 years agoOptimize install snapshot, by making a call at end of installsnapshotreply 10/15010/3
Harman Singh [Fri, 6 Feb 2015 19:38:14 +0000 (11:38 -0800)]
Optimize install snapshot, by making a call at end of installsnapshotreply

Change-Id: I956a6b8653b3a9d27cdaf6a8c8b12287caeffb22
Signed-off-by: Harman Singh <harmasin@cisco.com>
9 years agoOptimized AppendEntries sending to follower by adding AppendEntry call at end of... 68/14868/7
Harman Singh [Thu, 5 Feb 2015 01:43:48 +0000 (17:43 -0800)]
Optimized AppendEntries sending to follower by adding AppendEntry call at end of reply, if needed.

This will help to reduce the lag of a follower and leader does not have to wait for heartbeat time to
send a message to follower. This way, we can tune heartbeat interval in better manner.

Change-Id: I0259ea3691a3ac1245e36afe15b06ed44f377466
Signed-off-by: Harman Singh <harmasin@cisco.com>
9 years agoInitial heartbeats not sent by Leader 25/15125/3
tpantelis [Mon, 9 Feb 2015 06:52:19 +0000 (01:52 -0500)]
Initial heartbeats not sent by Leader

When a Leader instance is created, it immediately sends out heartbeats
to the followers. However recent changes broke this behavior as
sendAppendEntries now checks if the follower's timeSinceLastActivity >=
heartbeat interval. However, in this case, timeSinceLastActivity is 0 so
the initial heartbeats aren't sent out. Also, on replication, it seems
that sendAppendEntries should always send AppendEntries. So we want to
disable this checking in these 2 cases. We only want check
timeSinceLastActivity if it's initiated by a scheduled heartbeat.

To resolve this, I changed the Leader constructor to directly call
sendAppendEntries instead of scheduling SendHeartbeat with delay 0. I
now pass in the interval to sendAppendEntries. The scheduled heartbeat
passes in the actual heartbeat interval and the oher 2 calls pass in 0.

Several unit tests in LeaderTest had to be changed due to the new
behavior.

Change-Id: I138db649b49ca18070a3247312521daf0dabc88e
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoBug-2692:Avoid fake snapshot during initiate snapshot 91/15091/2
Kamal Rameshan [Mon, 9 Feb 2015 22:56:30 +0000 (14:56 -0800)]
Bug-2692:Avoid fake snapshot during initiate snapshot

When an initiate snapshot is received , we should be setting the snapshot captured flag, in order to avoid a fake snapshot at the same time.

Also a check should be made to avoid another initiate snapshot to occur, in case the capture snapshot takes time.

Change-Id: I6e29c97b8cc71c101504cb3588897a896e107e93
Signed-off-by: Kamal Rameshan <kramesha@cisco.com>
9 years ago(Fix: Bug 2529) 03/15003/2
mark.mozolewski [Fri, 6 Feb 2015 23:01:29 +0000 (15:01 -0800)]
(Fix: Bug 2529)
- Now ShardTransaction does NOT return CloseTransactionReply for Read-Only transactions.

- Separated ShardTransactionTest cases for RW/WO/RO Shard Transactions to test expected CloseTransactionReply behavior for each.
- Updated ShardTransaction Javadoc since ShardTranactionCreater#create method and ShardTransaction subclasses imply javadoc comment was wrong about applicability to other transaction types.

Change-Id: I46aa6025b0a975c4592344bbee2d917574f2c750
Signed-off-by: mark.mozolewski <mark.mozolewski@hp.com>
9 years agoMerge "Bug 2410: Use generated serialVersionUID for messages"
Moiz Raja [Mon, 9 Feb 2015 18:11:26 +0000 (18:11 +0000)]
Merge "Bug 2410: Use generated serialVersionUID for messages"

9 years agoMerge "Fix NPE in AbstractLeader#handleInstallSnapshotReply"
Moiz Raja [Mon, 9 Feb 2015 18:10:11 +0000 (18:10 +0000)]
Merge "Fix NPE in AbstractLeader#handleInstallSnapshotReply"

9 years agoAdd Distributed DataStore as a dependency of the Simulator 80/15080/1
Moiz Raja [Mon, 9 Feb 2015 17:37:36 +0000 (09:37 -0800)]
Add Distributed DataStore as a dependency of the Simulator

This is because AppendEntries delivers the ModificationPayload from
DDS and without adding a dependency on DDS we get a ClassNotFoundException

Change-Id: Ie4a938ad859db916a0fdbb33d8ce888ae4abf80b
Signed-off-by: Moiz Raja <moraja@cisco.com>
9 years agoBUG-2599 Netconf notification manager initial API and Impl 21/14921/5
Maros Marsalek [Thu, 5 Feb 2015 13:54:40 +0000 (14:54 +0100)]
BUG-2599 Netconf notification manager initial API and Impl

Change-Id: I71569f08aff3738ea7fa4d5f1853079b4a2b0fb5
Signed-off-by: Maros Marsalek <mmarsale@cisco.com>
9 years agoBUG-2310 - widen yang model for netconf-node. 66/14566/5
Tomas Cere [Tue, 20 Jan 2015 12:18:07 +0000 (13:18 +0100)]
BUG-2310 - widen yang model for netconf-node.

Netconf datastore is now in topology, added connection state,
resolved/unresolved schemas with failure reasons and host to netconf node.
Deprecated old netconf node in inventory.

Change-Id: Id34a17b82420eaf69d03d72b9a1523210cc87cc2
Signed-off-by: Tomas Cere <tcere@cisco.com>
9 years agoMerge "BUG-2599 Add netconf notifications yang models"
Tony Tkacik [Mon, 9 Feb 2015 10:14:01 +0000 (10:14 +0000)]
Merge "BUG-2599 Add netconf notifications yang models"

9 years agoBUG-2288: implement DOMNotificationRouter 78/13478/15
Robert Varga [Tue, 9 Dec 2014 14:09:59 +0000 (15:09 +0100)]
BUG-2288: implement DOMNotificationRouter

Implements DOMNotification(Publish)Service using LMAX Disruptor. The
disruptor is used internallly to transfer requests from publishers to
two-stage notification dispatch, where the frist stage takes care of
delivering events to subscribers and the second stage notifies the
futures.

Change-Id: I654d9d044e80b2a2ff6fd5b05ddceed4e79a4ebc
Signed-off-by: Robert Varga <rovarga@cisco.com>
9 years agoBUG-2599 Add netconf notifications yang models 20/14920/3
Maros Marsalek [Thu, 5 Feb 2015 13:52:34 +0000 (14:52 +0100)]
BUG-2599 Add netconf notifications yang models

Change-Id: Ie35cf3c6cdee89f0bd88ba79b974dff529897809
Signed-off-by: Maros Marsalek <mmarsale@cisco.com>
9 years agoBug 2669: Use slf4j Logger instead of akka LoggingAdapter 10/14810/6
tpantelis [Sun, 1 Feb 2015 21:52:59 +0000 (16:52 -0500)]
Bug 2669: Use slf4j Logger instead of akka LoggingAdapter

Change-Id: I8ca8d4979448cb158f6fb2dd89124a3b4e6e39e8
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoFix missing log argument 30/15030/1
Robert Varga [Sat, 7 Feb 2015 20:17:06 +0000 (21:17 +0100)]
Fix missing log argument

Logging format indicates an argument, but it is missing in the method
arguments.

Change-Id: I961088d5534370227e741ee0b1ff9651fbcd3335
Signed-off-by: Robert Varga <rovarga@cisco.com>
9 years agoFix NPE in AbstractLeader#handleInstallSnapshotReply 44/14744/7
tpantelis [Sun, 1 Feb 2015 06:53:48 +0000 (01:53 -0500)]
Fix NPE in AbstractLeader#handleInstallSnapshotReply

The "if" statement checks "followerToSnapshot != null" but the else clause doesn't
causing an NPE. Changed it to check "followerToSnapshot == null"
earlier and return.

Also added some more debug logging and optimized sendAppendEntries and
sendSnapshotChunk to call mapFollowerToSnapshot.get(...) once to elimnate
redundant lookups.

Change-Id: I014cd6ecb47edebb17041433f229eb809ec8689d
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoRemove unnecessary declaration of <prerequisites> in logback 35/14235/5
Thanh Ha [Mon, 19 Jan 2015 03:50:07 +0000 (22:50 -0500)]
Remove unnecessary declaration of <prerequisites> in logback

Bug: 2605
Change-Id: I4c9fbd672bc2b6a9b52163d989fed155695ba3ee
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
9 years agoRemove unnecessary declaration of <prerequisites> in netty 34/14234/5
Thanh Ha [Mon, 19 Jan 2015 03:49:38 +0000 (22:49 -0500)]
Remove unnecessary declaration of <prerequisites> in netty

Bug: 2605
Change-Id: I3a62789b56a0d5f91e51fa2bc5bcc15e1220f1f4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
9 years agoRemove unnecessary declaration of <prerequisites> in threadpool 33/14233/5
Thanh Ha [Mon, 19 Jan 2015 03:48:52 +0000 (22:48 -0500)]
Remove unnecessary declaration of <prerequisites> in threadpool

Bug: 2605
Change-Id: I228eab8e1e90ff7867ac4b850dee7294679aab1b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
9 years agoRemove unnecessary declaration of <prerequisites> in yang 32/14232/5
Thanh Ha [Mon, 19 Jan 2015 03:47:56 +0000 (22:47 -0500)]
Remove unnecessary declaration of <prerequisites> in yang

Bug: 2605
Change-Id: I08d737f0c123e3f4aa64261c2ec518e1a8a71d80
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
9 years agoRemove unnecessary declaration of <prerequisites> in config-subsystem 31/14231/5
Thanh Ha [Mon, 19 Jan 2015 03:47:19 +0000 (22:47 -0500)]
Remove unnecessary declaration of <prerequisites> in config-subsystem

Bug: 2605
Change-Id: I99ffc16c036324c846383083c5d81822012613f2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
9 years agoRemove unnecessary declaration of <prerequisites> in netconf 30/14230/5
Thanh Ha [Mon, 19 Jan 2015 03:44:27 +0000 (22:44 -0500)]
Remove unnecessary declaration of <prerequisites> in netconf

Bug: 2605
Change-Id: Ibfe6c6329b836361248c6e008be8cd1566bbeec7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
9 years agoRemove unnecessary declaration of <prerequisites> in karaf 29/14229/5
Thanh Ha [Mon, 19 Jan 2015 03:43:20 +0000 (22:43 -0500)]
Remove unnecessary declaration of <prerequisites> in karaf

Bug: 2605
Change-Id: I135ee73839564659b17ab9a902aa2c1993bc2008
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
9 years agoUse Maven Enforcer plugin to require Maven version 28/14228/5
Thanh Ha [Mon, 19 Jan 2015 03:42:26 +0000 (22:42 -0500)]
Use Maven Enforcer plugin to require Maven version

Using the <prerequisites> configuration in pom files is deprecated and
it is recommended to use the maven-enforcer-plugin to enforce these
rules instead.

See:
http://jira.codehaus.org/browse/MNG-5297
http://jira.codehaus.org/browse/MNG-4840

Bug: 2605
Change-Id: Ie7bac4fc00ba41e1bcdbcbe483e29ca22d40bd1f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
9 years agoRemove unnecessary declaration of <prerequisites> in root-pom 27/14227/5
Thanh Ha [Mon, 19 Jan 2015 03:36:53 +0000 (22:36 -0500)]
Remove unnecessary declaration of <prerequisites> in root-pom

Bug: 2605
Change-Id: Ia836f2e59b1edc295f8bc4bfe55388e839f18b7c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
9 years agoRemove unnecessary declaration of <prerequisites> in config-plugin-parent 26/14226/5
Thanh Ha [Mon, 19 Jan 2015 03:35:39 +0000 (22:35 -0500)]
Remove unnecessary declaration of <prerequisites> in config-plugin-parent

Bug: 2605
Change-Id: I095edd9cd818542eafb89cb8a3ca9345c0a9095b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
9 years agoMerge "Bug-2590: Clustering : Minimize usage of in-memory journal"
Moiz Raja [Fri, 6 Feb 2015 23:06:10 +0000 (23:06 +0000)]
Merge "Bug-2590: Clustering : Minimize usage of in-memory journal"

9 years agoMerge "Fix potential issue with transaction timeouts"
Moiz Raja [Fri, 6 Feb 2015 22:46:58 +0000 (22:46 +0000)]
Merge "Fix potential issue with transaction timeouts"

9 years agoMerge "Added requuired-capabilities to the impl/.../config/default-config.xml and...
Ed Warnicke [Fri, 6 Feb 2015 19:58:35 +0000 (19:58 +0000)]
Merge "Added requuired-capabilities to the impl/.../config/default-config.xml and added relativePath statement to avoid maven warnings"

9 years agoBug-2590: Clustering : Minimize usage of in-memory journal 15/14615/10
Kamal Rameshan [Thu, 29 Jan 2015 19:44:30 +0000 (11:44 -0800)]
Bug-2590: Clustering : Minimize usage of in-memory journal

In order to minimize the memory usage of the in-memory journal, we can remove the entries from the Leader's journal
once it has been successfully replicated to ALL its followers.
This does not intefere with snapshots, as we capture snapshots on demand.

The followers follow the leader in cleaning the in-memory journal, there by ensuring that all the journals have more or less same entries.
This is done by the leader passing its replicatedToAllIndex as part of the AppendEntries.

Change-Id: I579a1f90d3c4e5d6be4ce699072688788b07bd48
Signed-off-by: Kamal Rameshan <kramesha@cisco.com>
9 years agoMerge "BUG-2599 Add base netconf ynag model: ietf-netconf"
Tony Tkacik [Fri, 6 Feb 2015 15:44:01 +0000 (15:44 +0000)]
Merge "BUG-2599 Add base netconf ynag model: ietf-netconf"

9 years agoMerge "Add (un)lock ops to netconf testtool"
Tony Tkacik [Fri, 6 Feb 2015 13:34:49 +0000 (13:34 +0000)]
Merge "Add (un)lock ops to netconf testtool"

9 years agoBUG-2599 Add base netconf ynag model: ietf-netconf 19/14919/2
Maros Marsalek [Thu, 5 Feb 2015 13:52:04 +0000 (14:52 +0100)]
BUG-2599 Add base netconf ynag model: ietf-netconf

Change-Id: I6f9bcdb5517f0c0433a943f99cebde4bc5a273bc
Signed-off-by: Maros Marsalek <mmarsale@cisco.com>
9 years agoBUG-2681: switch sal-binding-it to sal test models 28/14928/5
Michal Rehak [Thu, 5 Feb 2015 11:31:15 +0000 (12:31 +0100)]
BUG-2681: switch sal-binding-it to sal test models

 - switched to test models:
    - DataServiceTest
    - RoutedServiceTest (unregister path verification failing)
    - Notification Test

Change-Id: I381fd9ad9682f9527bdf8276fae6eb508f0807f7
Signed-off-by: Michal Rehak <mirehak@cisco.com>
9 years agoSilence an NPE in the DataChangeListenerRegistrationProxyTest 71/14871/2
Moiz Raja [Thu, 5 Feb 2015 02:41:13 +0000 (18:41 -0800)]
Silence an NPE in the DataChangeListenerRegistrationProxyTest

This NPE was happening because the actorContext mock was not setup
to return a DataStoreContext

Change-Id: I433414bc444d7b1fe3c7886cea7ddef2e4b1ccb8
Signed-off-by: Moiz Raja <moraja@cisco.com>
9 years agoMerge "Improve Shard logging output"
Moiz Raja [Thu, 5 Feb 2015 23:47:57 +0000 (23:47 +0000)]
Merge "Improve Shard logging output"

9 years agoAdded requuired-capabilities to the impl/.../config/default-config.xml and added... 53/14853/4
John Burns [Wed, 4 Feb 2015 20:58:26 +0000 (12:58 -0800)]
Added requuired-capabilities to the impl/.../config/default-config.xml and added relativePath statement to avoid maven warnings

Change-Id: I2a0d7cd2700b4060cb172b898b6d80b227f0a06c
Signed-off-by: John Burns <johnburn@cisco.com>
9 years agoSkip install and deploy of aggregator artifact. 61/14861/2
Nathan Harmon [Wed, 4 Feb 2015 21:55:17 +0000 (13:55 -0800)]
Skip install and deploy of aggregator artifact.

Change-Id: I12ef594c27c6376b543eb9bc85843d4eb0b7a3dc
Signed-off-by: Nathan Harmon <nathan.harmon@hp.com>
9 years agoBUG-2679 Workaround for wrong nagasena encode/decode with reused transmogrifier 03/14903/2
Maros Marsalek [Thu, 5 Feb 2015 09:53:41 +0000 (10:53 +0100)]
BUG-2679 Workaround for wrong nagasena encode/decode with reused transmogrifier

Change-Id: I76b94b896e138e778f0a6abd6d42a481347f1a13
Signed-off-by: Maros Marsalek <mmarsale@cisco.com>
9 years agoAdd (un)lock ops to netconf testtool 17/14917/2
Maros Marsalek [Thu, 5 Feb 2015 12:48:17 +0000 (13:48 +0100)]
Add (un)lock ops to netconf testtool

Change-Id: I48ea8e8ce0edeb9428d87f5bcac5ba8d3a2ede22
Signed-off-by: Maros Marsalek <mmarsale@cisco.com>
9 years agoStandardize on pax-exam 4.4.0 16/14916/1
Robert Varga [Thu, 5 Feb 2015 13:11:56 +0000 (14:11 +0100)]
Standardize on pax-exam 4.4.0

The version is implied from odlparent, make sure we use the same
property and not override it.

Change-Id: I6a997f636e862a991f2d5baa73738d6f6fb65b7c
Signed-off-by: Robert Varga <rovarga@cisco.com>
9 years agoBump pax exam version 15/14915/2
Marian Dubai [Thu, 5 Feb 2015 12:56:43 +0000 (13:56 +0100)]
Bump pax exam version

Change-Id: I7126f464aa1d55307ca2d9ba0060d3abf600b5f0
Signed-off-by: Marian Dubai <mdubai@cisco.com>
9 years agoMerge "BUG-2288: remove DOMNotificationListenerRegistration"
Tony Tkacik [Thu, 5 Feb 2015 09:57:50 +0000 (09:57 +0000)]
Merge "BUG-2288: remove DOMNotificationListenerRegistration"

9 years agoMerge "Improve JavaAttribute performance"
Tony Tkacik [Thu, 5 Feb 2015 09:55:03 +0000 (09:55 +0000)]
Merge "Improve JavaAttribute performance"

9 years agoMerge "Make sure write transaction cancellation is propagated"
Tony Tkacik [Thu, 5 Feb 2015 09:54:45 +0000 (09:54 +0000)]
Merge "Make sure write transaction cancellation is propagated"

9 years agoMerge "Dummy Distributed Data Store for testing replication"
Tom Pantelis [Thu, 5 Feb 2015 03:54:52 +0000 (03:54 +0000)]
Merge "Dummy Distributed Data Store for testing replication"

9 years agoMerge "neutron now works with jetty"
Moiz Raja [Wed, 4 Feb 2015 22:31:43 +0000 (22:31 +0000)]
Merge "neutron now works with jetty"

9 years agoDummy Distributed Data Store for testing replication 05/14805/3
Moiz Raja [Sat, 24 Jan 2015 13:58:35 +0000 (05:58 -0800)]
Dummy Distributed Data Store for testing replication

To use this run a real instance of the controller on your laptop.
Modify the module-shards.conf to replicate modules to member-2 or
member-2 and member-3 as neccessary.

Then run the dummy datastore.

For example,

   java -jar ./target/sal-dummy-distributed-datastore-1.2.0-SNAPSHOT-allinone.jar -member-name member-2 -cause-trouble -drop-replies -max-delay-millis 500

Runs the dummy datastore as member-2. Will cause failures including dropped replies and when it does reply may cause a random delay of upto
500 millis

This will start of the dummy datastore which will then spawn dummy shard actors which will listen to the RequestVote
and AppendEntries messages. For RequestVote messages it will always respond with a positive vote and for AppendEntries
it will put a sleep for a randomized interval upto the max delay.

Change-Id: Ib618365f12bcc714fcf45e29051f8796f798a361
Signed-off-by: Moiz Raja <moraja@cisco.com>
9 years agoMerge "BUG 2667 : Handle null value type"
Tom Pantelis [Wed, 4 Feb 2015 16:11:01 +0000 (16:11 +0000)]
Merge "BUG 2667 : Handle null value type"

9 years agoBUG-2288: remove DOMNotificationListenerRegistration 27/14827/1
Robert Varga [Wed, 4 Feb 2015 14:18:37 +0000 (15:18 +0100)]
BUG-2288: remove DOMNotificationListenerRegistration

This type is just a capture, and it fails to forward the type of the
listener properly for users. Remove it and be more consistent with the
design of other classes.

Change-Id: Ib8c3db54fc599d6ca194d1667e1a48a98e455180
Signed-off-by: Robert Varga <rovarga@cisco.com>
9 years agoMerge "Bug2268: Deprecate legacy Payload classes"
Moiz Raja [Wed, 4 Feb 2015 05:14:31 +0000 (05:14 +0000)]
Merge "Bug2268: Deprecate legacy Payload classes"

9 years agoMerge "Bug 2264: Use streaming for snapshots"
Moiz Raja [Wed, 4 Feb 2015 05:13:48 +0000 (05:13 +0000)]
Merge "Bug 2264: Use streaming for snapshots"

9 years agoMerge "Refactor TransactionProxy"
Moiz Raja [Wed, 4 Feb 2015 03:01:40 +0000 (03:01 +0000)]
Merge "Refactor TransactionProxy"

9 years agoAdd features-restconf to mdsal-artifacts 91/14791/1
Ed Warnicke [Tue, 3 Feb 2015 22:18:21 +0000 (15:18 -0700)]
Add features-restconf to mdsal-artifacts

Change-Id: I1919153b372d2b7323fb1179ad04f9d3a491b29f
Signed-off-by: Ed Warnicke <eaw@cisco.com>
9 years agoBUG 2667 : Handle null value type 89/14789/1
Moiz Raja [Tue, 3 Feb 2015 21:13:59 +0000 (13:13 -0800)]
BUG 2667 : Handle null value type

Modified the code to handle null types in leaf and leafset entries since
they are allowed. This should help avoid atleast some of the issues seen
by GBP.

Change-Id: Id24e03738e9b5490c8221fbf31ec0734c58655bb
Signed-off-by: Moiz Raja <moraja@cisco.com>
9 years agoneutron now works with jetty 46/13546/7
Ed Warnicke [Wed, 10 Dec 2014 16:55:24 +0000 (10:55 -0600)]
neutron now works with jetty

This patch makes the feature neutron-northbound work with
jetty.

It also moves the adsal to port 8282, and the stock
karaf jetty to port 8080 (in additional to 8181).

GET, POST, and PUT for neutron network has been
tested:

GET:

curl -u admin:admin http://127.0.0.1:8080/controller/nb/v2/neutron/networks

POST:

curl -u admin:admin -H "Content-Type: application/json" -d @network.post http://127.0.0.1:8080/controller/nb/v2/neutron/networks

PUT:

curl -u admin:admin -H "Content-Type: application/json" -d @network2.post -X PUT  http://127.0.0.1:8080/controller/nb/v2/neutron/networks/d6220bbb-35f3-48ab-8eae-69c60aef3544

where:

cat network.post
{"network": {"status": "ACTIVE", "subnets": [], "name": "net-dedicated", "provider:physical_network": null, "admin_state_up": true, "tenant_id": "aa902936679e4ea29bfe1158e3450a13", "provider:network_type": "gre", "router:external": false, "shared": false, "id": "d6220bbb-35f3-48ab-8eae-69c60aef3544", "provider:segmentation_id": 1}}

cat network2.post
{"network": {"subnets": [], "name": "net-dedicated", "provider:physical_network": null, "admin_state_up": true, "provider:network_type": "gre", "router:external": true, "shared": false, "provider:segmentation_id": 1}}

This patch should not be merged before 2/1/2015 to allow time for discussion.

Change-Id: I6a003c2868adc5b060f05d228a56a744c092e963
Signed-off-by: Ed Warnicke <eaw@cisco.com>
9 years agoMerge "Bug 2268: Serialize ApppendEntries"
Moiz Raja [Tue, 3 Feb 2015 18:50:27 +0000 (18:50 +0000)]
Merge "Bug 2268: Serialize ApppendEntries"

9 years agoMerge "Mark AD-SAL interfaces as deprecated"
Moiz Raja [Tue, 3 Feb 2015 18:35:54 +0000 (18:35 +0000)]
Merge "Mark AD-SAL interfaces as deprecated"

9 years agoFix potential issue with transaction timeouts 62/14662/4
tpantelis [Sat, 31 Jan 2015 04:52:15 +0000 (23:52 -0500)]
Fix potential issue with transaction timeouts

If CanCommit is sent for a transaction but there is already a current
transaction being committed, the second transaction is queued and
processed when the current transaction completes. However when the
second transaction is de-queued and CanComitted, the last access time
is not updated. There is a periodic timer task that checks if the current
transaction has not been accessed after a relatively long period of time
(eg if CanCommit was sent but Commit isn't sent possibly due to network
failure). In this case the current transaction is aborted. So if a
transaction was queued for a long enough period of time, when it becomes
the current transaction, the timer task could run and abort it before
the front-end has a chance to send the Commit. To prevent this, the
de-queued transaction's access time is updated when it it made the
current transaction.

I also changed the commit() and preCommit() calls to the InMemoryDataStore
to catch Exception as the InMemoryDataStore can throw unchecked
exceptions. If uncaught, the exception is propagated to akka and no
response is sent.

Change-Id: I516bde86f45272f2d40fab76acbc27180e2ad402
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoFix opendaylight-startup-archetype to use ${project.groupId} instead of ${groupId}. 03/14703/1
Nathan Harmon [Mon, 2 Feb 2015 23:40:11 +0000 (15:40 -0800)]
Fix opendaylight-startup-archetype to use ${project.groupId} instead of ${groupId}.

Change-Id: I3ce96492d149c466b93539e9254f93074e1f036c
Signed-off-by: Nathan Harmon <nathan.harmon@hp.com>
9 years agoMerge "Improve cluster test app logging"
Moiz Raja [Mon, 2 Feb 2015 23:37:36 +0000 (23:37 +0000)]
Merge "Improve cluster test app logging"

9 years agoAdd signature marker and version to NormalizedNode streaming 62/14862/2
tpantelis [Mon, 2 Feb 2015 08:42:37 +0000 (03:42 -0500)]
Add signature marker and version to NormalizedNode streaming

For backwards compatibility, in some message classes, when
de-serializing, we first try the new NormalizedNode streaming and if
that fails we try the pre-Lithium protobuff de-serialization. However,
we're relying on an IOException from the NormalizedNode streaming or it
returning null which may not be reliable. In addition if protobuff fails
as well we can't tell if it's a bad protobuff or streamed message and we
squash the streaming exception. We don't want to masking streaming failures
as that's what will be used going forward.

To alleviate this, NormalizedNodeOutputStreamReader now writes an initial byte
as a signature marker to identify it as a valid stream.
NormalizedNodeInputStreamReader reads it, and if invalid, throws an
exception. This is caught by SerializationUtils as an indication to try
the legacy protobuff de-serialization.

Also, I added a version number to the output stream so we can handle
future changes for backwards compatibility.

Change-Id: I19779aa83c33eadc6bf83adfe6aae0b9a27cdfae
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoBug 2410: Use generated serialVersionUID for messages 36/14836/2
tpantelis [Mon, 2 Feb 2015 03:10:19 +0000 (22:10 -0500)]
Bug 2410: Use generated serialVersionUID for messages

Changed the remaining message classes whose serialVersionUID had
previously been set to 1 to the generated value to maintain
backwards compatibility with Helium.

It turns out CommitEntry, PersistEntry, and SaveSnapShot are no longer
used so I removed them.

Change-Id: Ib3c251b7eaf8b8ce5aa4edf693aca23bf67d0402
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoRefactor TransactionProxy 18/14618/3
Gary Wu [Thu, 29 Jan 2015 22:24:18 +0000 (14:24 -0800)]
Refactor TransactionProxy

Consolidated three transaction operation interfaces
into one.  Eliminated creation of redundant future/promise
objects for queued read operations.

Change-Id: I12a91cac5298f2722e30ed52ee91e35fdf1104d6
Signed-off-by: Gary Wu <Gary.Wu1@huawei.com>
9 years agoImprove Shard logging output 60/14660/6
tpantelis [Fri, 30 Jan 2015 23:29:15 +0000 (18:29 -0500)]
Improve Shard logging output

When debugging it's useful to see the shard name in the log output.

Also changed ShardIdentifier to cache the toString() output as the
class is immutable so we don't incur the overhead of building the
String for every log message.

Change-Id: Ic7ea9878eeab04ea9b43a25b7d4b2b190f79e607
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoMark AD-SAL interfaces as deprecated 92/14392/4
Ed Warnicke [Thu, 22 Jan 2015 17:31:04 +0000 (10:31 -0700)]
Mark AD-SAL interfaces as deprecated

In keeping with TSC discussion on marking AD-SAL
deprecated during Lithium.

Change-Id: If0f7736dfe92833b51a1e223b705712d9b9f0271
Signed-off-by: Ed Warnicke <eaw@cisco.com>
9 years agoBug2268: Deprecate legacy Payload classes 97/14497/2
tpantelis [Wed, 21 Jan 2015 21:18:17 +0000 (16:18 -0500)]
Bug2268: Deprecate legacy Payload classes

Mark CompositeModificationByteStringPayload and
CompositeModificationPayload as deprecated.

Change-Id: I788baab09770d305c9fde9b4988fad9e58663ded
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoBug 2264: Use streaming for snapshots 20/14620/3
tpantelis [Thu, 29 Jan 2015 13:35:59 +0000 (08:35 -0500)]
Bug 2264: Use streaming for snapshots

The NormalizedNode snapshot payload is now streamed.

On the Shard side, added a new message CreateSnapsot to the
ShardReadTransaction to read the data tree root, serialize it, and
return a CaptureSnapshotReply message. On createSnapshot, the Shard
now sends the CreateSnapsot message to the read-only tx actor instead
of a ReadData message. This moves the serialization out of the Shard.

On the RaftActor side, the Snapshot class remained the same as it stores
a byte[] and is already Serializable. The CaptureSnapshotReply now
stores a byte[] instead of ByteString. The internal RaftActor code for
capture and apply snapshot was changed to use/pass byte[] to eliminate
the overhead of converting to/from ByteString.

Change-Id: Id12677441dce54bebbb5b71c68cf457d7c915ba1
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoBug 2268: Use streaming for Modification payload 95/14495/6
tpantelis [Wed, 21 Jan 2015 19:45:42 +0000 (14:45 -0500)]
Bug 2268: Use streaming for Modification payload

Changed the *Modification classes to Externalizable and to use the
NormalizedNode streaming classes.

Added a new Payload implementation, ModificationPayload, that serializes the
Modification to a byte[].

Added ThreadLocals to SerializationUtils to reuse stream Reader/Writer
instances for efficiency for callers that serialize/deserialize multiple
objects.

Change-Id: Ib85af035d31027ffe4e2ddd5bcd49c1df1c6a42a
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoBug 2268: Serialize ApppendEntries 83/14483/5
tpantelis [Wed, 21 Jan 2015 20:12:24 +0000 (15:12 -0500)]
Bug 2268: Serialize ApppendEntries

Changed AppendEntries to use java serialization instead of protobuff to
take advantage of payload streaming. Kept backwards compatibility
support for deserializing from the pre-Lithium protobuff message.

Change-Id: Ia1edf186cbe8eba3f46207bcf3ba17598c5bca37
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoImprove cluster test app logging 63/14663/1
tpantelis [Sat, 31 Jan 2015 05:18:30 +0000 (00:18 -0500)]
Improve cluster test app logging

Made a few improvements to the logging in PeopleCarListener and
PeopleProvider to help debugging test failures.

Change-Id: I25d27e4abbc4b0096b2dc812bfcbada208c588e4
Signed-off-by: tpantelis <tpanteli@brocade.com>
9 years agoImprove JavaAttribute performance 13/14513/2
Robert Varga [Mon, 26 Jan 2015 17:05:37 +0000 (18:05 +0100)]
Improve JavaAttribute performance

Instead of performing Arrays.copyOf(), use the .clone() method, which is
guaranteed to return a shallow copy.

Change-Id: Ided53e90693b28f924c056189abd7257647fe079
Signed-off-by: Robert Varga <rovarga@cisco.com>