c5ec34d5a5
Actually hook in new assimilation behavior
...
Additionally, use collective member name as
tiebreaker if txcount and follower count is
identical.
2021-04-07 13:15:36 -04:00
6a4086679c
Rework collective assimilation logic
...
Followers will only depart if their current leader
is assimilated.
Leaders with quorum will refuse assimilation and instruct
member trying to assimilate to join it.
Leaders without quorum will either follow the assimilation leader
or refuse, depending on who has highest transaction count, and if
a tie, which has the larger set of followers
2021-04-07 13:05:02 -04:00
3d2422ded3
Coerce iterator to list for length check
2021-04-07 08:40:18 -04:00
7d0f47bbcb
Correct syntax for measuring collective size
2021-04-07 08:31:29 -04:00
9a779f2dd2
Improve collective startup behavior
...
Have confluent focus on establishing quorum before
initiating headless console and discovery activity.
2021-04-07 07:58:10 -04:00
4724d9e45b
Eliminate one source of stale data leaking
...
If nodes are swapped, then clearing the attributes
did not clear some mappings.
2021-04-06 18:19:13 -04:00
8404ddf3a2
Fix import of sortutil
2021-04-06 10:43:37 -04:00
872a13589c
Sort collective members
...
Improve consistency of output by sorting the output.
2021-04-06 09:35:34 -04:00
670fc87e1d
Address several collective issues
...
When a stream has been deleted from cfgstreams, contiue exception
handling since the desired result.
For connections to a manager, institute a 15 second socket level timeout.
This avoids an abandoned server conversation from locking a colleective member startup.
When scheduling the failover check, first block any redundant attempts to schedule.
Wrap the collective startup in an exception
handler, so that a retry is
more well guaranteed.
2021-04-05 16:39:41 -04:00
14d13749ad
Guarantee consoleserver init before use
...
During a restart, a client may aggressively trigger
console reconnect before the consoleserver starts.
Make sure that the daemon is running and globals
ready before API could possible ask for console.
2021-04-02 13:57:45 -04:00
d9051e80d3
Fix console buffer interaction
...
In some environments, the read method on the pipe object fails
to work, os.read should be the same, but seems to work better and
is happy to perform the opportunisticly large reads I want.
2021-04-02 12:29:41 -04:00
2d43fac1b5
Add a contingency for temporary read error
2021-04-02 11:54:38 -04:00
4a0d419f85
Improve behavior on python2 systems
2021-04-02 11:47:14 -04:00
b482410072
Have server pull in vtbufferd
2021-04-01 17:31:52 -04:00
beab6a3c02
Migrate VT buffering to c
...
C implementation to improve memory and cpu utilization.
Forked off to further move the work off the main process.
Still needs attribute rendition and packaging before merging to main
branch.
2021-03-31 17:28:26 -04:00
5e0ebce300
Add logs for offering boot
...
Make it easier to debug a failure
to boot due to misconfiguration.
2021-03-29 16:58:03 -04:00
85c4ec5654
Skip fqdn in cert generation
...
There are scenarios where getqfdn can induce a hang.
The certificate having FQDN isn't that useful anyway,
since confluent never uses it and external use of it
may need more carefully crafted certificate to have
a good chance of matching it anyway.
Also, the chances a user would import our cert as a
CA to something like a browser are low.
2021-03-29 14:29:42 -04:00
ca0c592044
Commence work on syncfileclient
...
This will be used to wait for deployer
to finish, then execute handlers
for 'MERGE' entries.
2021-03-25 16:55:56 -04:00
829d1316b2
Remove 'APPEND:'
...
If possible, we wannt to stick to 'MERGE', since the handlers
are designed to make that
idempotent for repeat.
APPEND: would not be idempotent...
2021-03-25 12:37:21 -04:00
c2c1c85651
Increase verbosity of syncfiles
2021-03-25 08:59:16 -04:00
c5833f1417
Reserve some characters for special syntax
...
May need to modify some behaviors in future, provide
a healthy supply of reserved characters toward that end.
2021-03-25 08:57:48 -04:00
07ae3593c3
Syncfiles fixes
2021-03-24 17:33:26 -04:00
8ab35b11cd
Add -a notation about syncfiles relevance
2021-03-24 16:01:48 -04:00
35ef6170ba
Implement syncfiles server side
2021-03-24 16:00:54 -04:00
d650f11255
Begin work on syncfiles concept for confluent
2021-03-23 17:32:45 -04:00
7c5dd85e74
Copy in ansible to genesis profiles
...
Make it clearer that there could be ansible support in genesis
2021-03-19 13:09:21 -04:00
df97e808c6
Wire up client retrieval of remoteconfig
...
remoteconfig can now watch for completion and return
data to client
2021-03-17 17:46:27 -04:00
98d14344ce
Have runansible complete execution
...
It now completes runs and stores results for retrieval by deploying node.
2021-03-17 16:54:37 -04:00
4818bd57bb
Advance state of runansible
...
Begin work to wire the results back to the supervisor and ultimately
back to the node affected.
2021-03-16 17:19:23 -04:00
7763327a63
Skip confluent import on exec
...
In main context, we don't need
sshutil, and python path is not
cooperative, so just skip it.
2021-03-16 16:23:27 -04:00
dac957364f
Merge branch 'master' into ansibleplay
2021-03-16 14:54:53 -04:00
7fdb4dccca
Fix network configuration changes through collective
2021-03-16 14:53:55 -04:00
a3c8c305c1
Add ansible supervisory code
2021-03-16 14:19:44 -04:00
f2cb6ea535
Merge branch 'master' into ansibleplay
2021-03-16 10:46:54 -04:00
5a81279b9d
Fix servicedata fetch
...
In the new framework with
filehandle passing, the provided
callback must accept a data
argument. get_diags can't
actually use it, but does have
to accept a token value.
2021-03-15 16:45:43 -04:00
7026fdfa3a
WIP change to enhance selfservice api for ansible
...
Begin work on extending selfservice to allow nodes
to request the deployer run ansible plays.
2021-03-12 12:23:58 -05:00
e38dbc4470
Pull in the automation key into default profiles
2021-03-10 15:41:01 -05:00
a26624a614
Use ssh-agent to store keys
...
Also add the 'automation' key for ansible to
take advantage of.
2021-03-10 15:41:01 -05:00
6a88f35fc2
Fix compatibility with some switch configurations
...
While some implementations mess up portid and need portdescr instead, others are
just the opposite.
Tolerate match either by description or name.
2021-03-10 13:40:47 -05:00
7a27fba94b
Workaround non-cisco switch crash
...
Querying Cisco MIB on certain
firmware levels of non-cisco switches
causes a crash. Tolerate and
wait a bit to give SNMP a chance to restart.
2021-03-10 09:51:05 -05:00
2a87c32800
Handle malformed json data more gracefully
2021-03-08 02:55:58 -05:00
2e63ff3aca
Close other places that may be false negative
...
Have checks for neightable be preceeded by an attempt to refresh,
to mitigate false negatives.
2021-03-05 13:14:41 -05:00
e3c17491e5
Attempt refresh of neigh table on miss
...
When an address is new it may not be in the last
captured neighbor table. Induce refresh before deciding
that neighbor is unavailable.
2021-03-05 13:08:25 -05:00
5a5b3f9927
Correct incorrect function call on image import
2021-03-04 16:55:26 -05:00
865d18d367
Back off progress update on file copy
...
The output was too frenzied, cool it down to fewer
updates.
2021-03-04 11:01:17 -05:00
b27d07f304
Fix nic index map with bonding
...
The assumption that /sys/class/net is interfaces is incorrect,
when encountering entries that are not interfaces, do not
mess up the call.
2021-03-04 10:47:28 -05:00
b1f1f15ba8
Fix filecopy and enhnance
...
shutil was copying from wrong
index. Stop using shutil and
bring it in, and instrument the
percentage.
2021-03-04 09:29:31 -05:00
09ca449eab
Fix iso import distinfo.yaml
...
If a copy method (e.g. ubuntu) is used, then distinfo.yaml is not
written. Fix by not overwriting the directory name.
2021-03-04 09:02:43 -05:00
d08ce9e563
Correct fd used in libarchive
...
Actually use the cloned file descriptors
2021-03-04 08:43:17 -05:00
ce92ea4084
Separate buffered and raw operation on filehandle
...
python and libarchive need different seek behaviors
with default file objects.
2021-03-04 08:30:05 -05:00
Jarrod Johnson