CHANGES
=======

0.8.18
------

* Update latest stable tag to 0.8.18
* [manila] Ensure default share type exists
* Skip "cat /proc/{pid}/cmdline" retries when the pid does not exist
* [tobiko-ensure-python3] Do not fail if upgrading packages fails
* 0.8.17 file for release notes

0.8.17
------

* Update latest stable tag to 0.8.17
* Address health monitor test feedback minor changes
* Add Health Monitor test for the OVN provider
* Add retries when checking if background ping started
* Better obtain MTU from neutron rather than from heat
* Add "Removed pandas dependency" release note
* Adapt releasenotes creation to python3.13
* Update upper-constraints.txt to fix tox-py313 job
* Replace pandas with TableData
* Add TableData class
* Fix linters and temporarily ignore py313 jobs
* Add documentation on how to use cifmw\_test\_operator\_tobiko\_patch
* 0.8.16 file for release notes

0.8.16
------

* Update latest stable tag to 0.8.16
* New update\_podified\_post testenv release note
* Retry command that gets pid's command line
* skip test\_delete\_ovn\_controller\_podified when no ovn-controller pods run
* Add kpatch verification tests for post-update validation
* Adapt class OvnUnsupportedDhcpOptionReader to typo fixed in neutron
* timeouted tests should fail instead of skip
* Use fixture to create Manila resources
* Append nodes to ocp-node and controller groups when needed

0.8.15
------

* Update latest stable tag to 0.8.15
* Fix tobiko MTU tests
* Refactor OCP nodes names and adjust node groups

0.8.14
------

* Update latest stable tag to 0.8.14
* stop\_script should not fail when kill command fails
* Pin pytest-rerunfailures to 15.1
* Remove PodifiedContainersHealthTest.test\_compute\_logrotate\_crond
* Kill all dhcp\_ping scripts found on the VM
* [CI] Use ovs-vsctl to ensure bridges
* Add .vscode to .gitignore
* Wait 3 secs before checking if background process started running
* Cleanup of unused dependencies
* Lock changes in shelves files
* Fix mypy by pinning types-paramiko to 3.5.0.20250801
* Add usage message to dectect new versions of IpUtilsIpVersionPingInterface
* Revert "Temporary skip metadata agent faults tests"
* \`\`OvnMetadataAgentTest\`\` to test OVN agent too
* Remove python-dateutil from requirements
* Temporary skip metadata agent faults tests
* Raise tobiko\_start\_pod\_timeout default value
* Cleanup of unused code
* Remove docker module
* 0.8.13 file for release notes

0.8.13
------

* Update latest stable tag to 0.8.13
* Add reboot\_node method to OcpNode class
* Start external process in background after previous verification fails
* Add maintenance test for iha in OSP17.1
* Add octavia-faults-after-oc-reboot workflow file
* Configure tobiko clients to close TCP connections
* Remove podman1 module
* Add create-check-resources workflow
* Skip background tests only when not really supported
* Add background DNS service test
* Fix test\_wait functional tests on ubuntu noble
* Make heat endpoint configurable
* Remove unused actors module
* Add openstack-tox-py39 to tobiko gates again
* Revert "Make devstack-tobiko-octavia jobs to be non-voting"
* Make assertion in stateless SG rules scenario got less strict
* Make devstack-tobiko-octavia jobs to be non-voting
* Fix log from wait\_for\_server\_status

0.8.12
------

* Update latest stable tag to 0.8.12
* Reduce retry interval from 5 to 3 for all loops involving OSP API requests
* Add background DHCP service test
* Prepare new module tobiko.shell.custom\_script
* Enable OVS jobs voting after LP#2114176 has been fixed

0.8.11
------

* Update latest stable tag to 0.8.11
* Lower glance retry interval to 3 seconds
* Update upper-constraints.txt to fix issues with new pytest-cov
* 0.8.10 file for release notes

0.8.10
------

* Update latest stable tag to 0.8.10
* Lower heat stack retry interval to 3 seconds
* Add support to run background http ping E-W test in Tripleo env
* Fix extra-requirements.txt for pandas versions
* Convert to str the elements from the pod \`args\` list
* Run ping with interval option only when the ping interface supports it
* remove duplicate IPUTILS\_PING\_USAGE
* Avoid overwriting log\_names\_mappings value from child classes
* Configure SELINUX=permissive persistently on Fedora images
* Make devstack\_neutron\_service configurable
* Change ping's interval config option's type to "int"
* Add 'interval' option to the tobiko ping CLI tool
* Add 'interval' option to the iperf3 run in background
* Implement background http ping running from the guest VM
* Implement http\_ping background tests run from the POD
* Fail if external process was not started properly
* Add "http ping" command to the Tobiko CLI tool
* Use maxprocesses instead of numprocesses pytest-xdist option
* Replace q-svc by neutron-api
* Adjust 'check\_vm\_evacuations'
* Extend guide for running Tobiko using ci-framework
* Cap types-setuptools package for mypy linter checks

0.8.9
-----

* Update latest stable tag to 0.8.9
* [podified] Dataplane secret name configurable
* parse properly iperf3 output when --json-stream is used
* Run background iperf3 tests with --json-stream option always
* Remove unneeded check\_ssh\_connection when ssh client is re-connected
* Retry to obtain the iperf log file until it is not empty
* Run background check\_function only if the process exists
* Wait until background iperf processes disappear
* Create VLAN on different parent interfaces for Customize Fedora image
* \_check\_ping\_results waits until log file is available
* 0.8.8 file for release notes

0.8.8
-----

* Update latest stable tag to 0.8.8
* Add release note for new background ping tests
* Add test\_check\_background\_vm\_ping\_east\_west
* Background tests wait after process is stopped
* bump os-traits to 3.4.0
* nit: irrelevant comment removed
* Add test-workflow-create-check-neutron-resources.yaml
* Always run background snat ping test from VM
* Allow to run background north-south iperf test from pod
* Fix remove\_log\_lines\_end\_json\_str function
* Nit changes within check\_ping\_statistics
* Remove unneeded skip\_background\_vm\_ping decorators
* Remove unneeded "import typing" and "noqa"
* 0.8.7 file for release notes

0.8.7
-----

* Update latest stable tag to 0.8.7
* Add SNAT background ping test
* Skip BackgroundProcessTest tests when ha\_faults are executed
* Update tobiko.conf.sample with recent changes
* Pin setuptools to 76.1.0
* Fix error when iperf3 client add some error warning in the report
* Add first health checks to faults podified ha tests
* Fix error parsing iperf result file empty
* Skip background tests earlier if topology does not support
* Add time to timeout to give time to galera to recover
* Add guide about running Tobiko using ci-framework
* Add docs guide about how to quickly prepare advanced image locally
* Add North-South traffic background iperf3 test
* Implement way to run iperf3 client in the POD
* Add way to return ShellCommand parameters as list
* Add support for the "--json-stream" option in iperf3 parameters
* Add Dockerfile for the iperf3 container image
* Add East-West traffic background iperf3 test
* Add methods to perform background iperf3 tests by various topologies
* Run iperf3 client (and server) in background
* Implement "\_\_contains\_\_" method for the ShellCommand class
* Add 'check\_or\_start\_external\_process' function
* Add AdvancedPeerServerStackFixture fixture
* Move rename\_ping\_staistics\_file\_to\_checked function to common os module
* Rename config option run\_background\_ping\_in\_pod
* Cache list of network extensions
* 0.8.6 file for release notes

0.8.6
-----

* Update latest stable tag to 0.8.6
* Add release note for ubuntu to fedora guest image changes
* Run podified tobiko background test on tripleo topologies
* nameservers are obtained from nmcli
* Replace Ubuntu guest images with Fedora
* Cleanup of infrared zuul jobs
* Replace third party mock
* Do not fail if no unreplied pings are found after reboot
* Cleanup tobiko jobs
* fix assert\_ovn\_containers\_running for podified envs
* Fix how tobiko\_pod\_extra\_network is added to tobiko background pod
* Tobiko does not customize images during run time
* image\_file parameter not supported anymore
* Remove ansible-lint from tobiko
* 0.8.5 file for release notes
* Raise tobiko\_start\_pod\_timeout to 100 seconds

0.8.5
-----

* Update latest stable tag to 0.8.5 and add release note
* Add config options for the tobiko background pod
* 0.8.4 file for release notes

0.8.4
-----

* Update latest stable tag to 0.8.4
* Add release notes for customize-ubuntu-guest-images-before-test-execution
* Make ubuntu\_interface configurable again
* Customize downloaded Ubuntu images
* Allow to disable image customizations
* [tobiko-inventory] Set to empty string the default ansible\_host value
* Remove UbuntuMinimalServerStackFixture and UbuntuMinimalImageFixture
* Include release notes in the main docs page of Tobiko
* Remove tobiko.run module
* Revert "Write background process tool"
* Tobiko adapted to python3.12
* add test remove all grastate.dat for OSP18 /refactor
* Add release notes for the background ping from POD
* Implement background ping from the POD
* Refactor background ping helper functions

0.8.3
-----

* Update latest stable tag to 0.8.3
* BackgroundProcessTest should only run background tests
* Patch paramiko to work with FIPs
* Add config option 'run\_background\_ping\_in\_pod'
* Let topology to decide how to start background ping
* Fix import of the stacks module in teh tripleo.nova module
* Use default pytest junit\_family
* Add Tobiko CLI tool to execute tobiko tools
* test\_restart\_frr not applied on all controllers

0.8.2
-----

* Update latest stable tag to 0.8.2
* Create workflows for podified faults and podified ha faults
* Lock deployment of LBs
* Remove passt when virt-customize does not work

0.8.1
-----

* Update latest stable tag to 0.8.1
* Use configured external network as floating network
* [octavia] Choose right external network when there is more than one
* add test remove all grastate.dat for OSP18
* tobiko test kill all galera services on podified env
* Fix issues with upstream jobs
* Upgrade pylint version
* Fix kill\_ovn\_controller\_podified test linters

0.8.0
-----

* Update latest stable tag to 0.8.0
* Remove UbuntuMinimalServerTest scenario tests
* Add ovn\_controller kill and delete\_pod
* External subnets with DHCP enabled should not be ignored
* [Podified] Run oc.selector().objects() commands on proper oc project
* Fix podified service and container names
* Skip service/container restarts on OCP nodes
* Connect to EDPM nodes with IP instead of hostname
* [Podified] Connect OVN NB DB from EDPM's ovn\_controller
* Fix tox testenvs with incorrect test paths

0.7.3
-----

* Update latest stable tag to 0.7.3
* add KUBECONFIG to tox.ini for OSP18
* Fix comparable\_container\_keys when the socket file includes hostname
* Fix get node\_status of edpm node
* Pin numpy to 1.26.4 (python3.9)
* Remove docker-tobiko jobs from check pipeline
* Fix ovn\_migration and ovn\_migration\_sanity testenvs
* Import openshift\_client optionally
* Set correct tox\_min\_version for the stable/2023.2 branch
* Simplify BaseResourceFixture.setup\_client
* Apply retries when ping execution fails due to ssh issues
* Lock external network stack creation between workers
* Upgrade sphinx version
* [Stateless SG] Add test for SG and Loadbalancer together
* Introduce new BaseResourceFixture class
* Use upper-constraints in the Tobiko ansible roles
* Add retries to ovn\_overcloud\_processes\_validations
* Refactoring tobiko lockers
* Fix two issues that broke tobiko gates
* Remove dependency with vulnerable library py - upgrade to tox>=4.13
* Fix tobiko.fail called from assert\_equal\_containers\_state
* Skip tests using heat when heat service is not deployed
* Add 'nova-custom-ceph' to COMPUTE\_DP\_SERVICE\_NAMES list
* Fix test\_hostnames test
* Fix link to Red Hat Openstack Platform reference

0.7.2
-----

* Update latest stable tag to 0.7.2
* Fix retries on get\_pcs\_resources\_table method
* Remove unused "deprecated" method
* Execute virt-customize with LIBGUESTFS\_BACKEND=direct
* class OvnUnsupportedDhcpOptionReader skipped with Podified setups
* [Podified] Run test\_list\_nodes\_processes only on compute nodes
* Implement power off and on EDPM nodes in the podified topology
* Fix security-group tests on Podified environments
* Fix discoverability of the EDPM nodes IP addresses
* [Podified] Add containers sanity tests for Podified topology
* [Podified] Make Topology class to decide about container runtime
* Fix importing openshift module
* Fix exceptions catched during check\_overcloud\_node\_uptime
* Ignore image\_dir when image\_file is a path
* Use configured process timeout when closing a process
* Added HOME env variable to tox testenv
* [openstackclient-cli] Use certificate when TLS-e is configured
* [Podified] Implement way to discover OCP workers
* [Podified] Recognition of the compute/networker/other edpm nodes
* Change name of controller\_galera\_main\_vip test
* Add RHOSP topology config options
* Fix Manila shares cleanup
* Run openstack command to apply quotas from the undercloud
* Add topology which represents Podified RHOSP deployment
* Remove containers' list file
* [tobiko-docker] Force docker version is lower than 7

0.7.1
-----

* Update latest stable tag to 0.7.1
* Add support to skip tests from CLI
* Increase retry timeout to obtain multi\_ip\_test\_fixture.vms\_detailed\_info
* Pin podman-py version to 4.7.0
* Fix cleanup octavia LBs
* New faults test test\_restart\_neutron
* Fix podman client creation with IPv6 control planes
* Manila share\_protocol value can be configured
* Move network\_undisrupt\_controller\_main\_vip to tearDown
* Add neutron-radvd to sidecar\_container\_list
* find\_ovn\_db\_ctl\_files only fails when file is not found
* Make ubuntu VM interface name configurable
* Make keystone endpoint interface configurable
* Ensure default manila share type exists
* Add cacert to manilaclient
* Set timeout to 40 secs for pcs status command
* Apply process timeout to process.send\_all method from sh.execute
* Add some logs with info about process retry loop
* Keystone password could be a number
* Add note in L3 agent test
* [Manila] pre-upgrade resource creation and post-procedure validation
* Update latest stable tag to 0.7.0
* [Faults] Verify that 'network\_disruption' method takes place

0.7.0
-----

* Fix is\_dvr\_enabled method when OVN is configured
* Skip background ping checks during controllers reboot with nonDVR
* Skip SharedFixture.cleanUp during check-resources steps
* Make ResourceFixtures configurable
* Create ResourceFixture: common class to manage OSP resources
* Add conditional trunk port
* Skip wait\_for\_guest\_os\_ready during check-resources
* Fix cleanup Loadbalancers task from tobiko-cleanup role
* Move sphinx\_rtd\_theme to the readthedocs requirements
* Wait for guest OS ready after starting a VM
* Stop using "system\_packages" in readthedocs builds
* Lock VM creation until guest OS is ready and cloud-init done
* [IR plugin] Copy cert file to tester\_node
* Fix test\_ipvX\_subnet\_nameservers when trunk ports are used
* Delegate tasks from the tobiko-cleanup role to undercloud
* Fix Octavia HA test\_stop\_haproxy
* Dropping python3.6 and python3.7 support

0.6.14
------

* Update latest stable tag to 0.6.14 - latest supporting python3.6
* Update latest stable tag to 0.6.13 - latest supporting python3.6

0.6.13
------

* Improve DisruptTripleoNodesTest tearDown
* Use uptime instead to verify controllers reboot has been completed
* Raise ServerNotFoundError when deleting a nonexistent VM
* Update latest stable tag to 0.6.12
* Stabilize test\_z99\_reboot\_controller\_galera\_main\_vip

0.6.12
------

* Re-execute podman client setup commands in case user has changed
* Remove tobiko-infrared-fedora jobs
* Adding more logs to test\_z99\_reboot\_controller\_galera\_main\_vip
* Add network disruption method for ipv6 deployments
* Improve reset\_all\_compute\_nodes method
* Resolve network stack creation concurrency issues
* Adapt test\_soft\_reboot\_computes\_recovery to Amphora LBs
* Revert "Regenerate HTML report files after any test case execution"
* Make check\_no\_duplicate\_ips function more verbose
* Add octavia health checks to faults/ha tests
* Make podman\_version\_3 method less verbose
* Align check of nodes responsiveness for all the cases
* Check containers are running after neutron services have been restarted
* workaround for filebeat: add newline at the end of xml reports
* podman error 137 is valid when killing ovn\_controller
* Avoid concurrency issues when creating Cirros and Ubuntu images
* Update latest stable tag to 0.6.11

0.6.11
------

* Increase timeout at test\_alive\_agents\_are\_consistent\_along\_time
* TestNetworkNoFipStackFixture should not be cleaned up
* Fix Octavia OVN provider scenario tests
* Fix Octavia Active/Standby tests
* [test\_0\_vlan\_ip\_addresses] Fix error message when IPs are missing
* Improve logs for test\_alive\_agents\_are\_consistent\_along\_time
* Use proper ceritificate when TLS-e is configured
* Add retries to find created ports at test\_ovsdb\_transation
* Add readthedocs.yaml configuration file
* Add upper-constraints file to the RTD requirements file
*  Update latest stable tag to 0.6.10

0.6.10
------

* Remove Heat stacks from Octavia
* Skip test\_ovs\_interfaces\_are\_absent after ovs2ovn
* Fix Octavia validators error about missing member
* Improve Octavia ovn provider scenario test
* Allow custom ubuntu timeouts
* Remove Fedora, Centos and RHEL from tobiko tests
* Fix error message when a stack is not deleted
* Make test\_z99\_reboot\_controller\_galera\_main\_vip more stable
* Skip some more tests related to ovn-migration
* Update latest stable tag to 0.6.9
* [BGP] Port tests without FIP
* Add faults ovn\_bgp\_agent and frr tests

0.6.9
-----

* Add new tox env and workflow for ovn\_migration sanity tests
* Don't run some of the stateless SG tests in ovn migration workflow
* Unskip UbuntuExternalPortTest tests on upstream jobs
* Workaround to avoid connectivity problems from ubuntu VM instances
* Create only one Sec Group per fixture
* Use Subnet pools to avoid cidr concurrency issues
* Fix faults tests when External LB is configured
* Do not upgrade virtualenv to the latest version
* Refactor test\_alive\_agents\_are\_consistent\_along\_time
* Fix neutron requests that are sent by background processes
* Add designate upstream job
* Fix captured exceptions and add some logs to test\_ovsdb\_transation
* Catch some exceptions when novaclient.list\_services is run
* Update github host key
* Remove designate\_faults testenv
* Fix basic Designate scenario test
* Make sphinx to generate Tobiko API docs based on docstrings
* Update latest stable tag to 0.6.8

0.6.8
-----

* Drop lib-validations dependency
* Refactor pcs commands execution
* Add designate IR plugin files
* Add test case to test ovn leadership change
* Fix get\_overcloud\_ssh\_username
* Add openstacksdk config options method
* Remove internal Red Hat URLs
* Obtain overcloud ssh username based on RHOSP release
* nit: fixed RetryAttempt details
* [Stateless SG] Add test to check there's no SG entries in conntrack
* Update latest stable tag to 0.6.7

0.6.7
-----

* Fix caught exception from disrupt\_controller\_galera\_main\_vip
* Remove TripleO jobs
* Improve faults tests' neutron agent health checks
* Exclude sidecar containers from the comparison of running containers
* Adapt test\_raft\_status to octavia and bgp
* [Designate] - basic scenario test
* Fix nova migration tests - update nova client microversion to 2.56
* Discard neutron replies when number of agents is 0
* Add test case to reboot controller hosting Galera VIP
* Increase timeout to recover neutron agents
* Remove RuntimeMaxSec from iperf systemd configuration
* Add openstacksdk to requirements
* Increase BW limit check intervales to 15%
* modify galera remove grastate.dat fault test
* Add script which helps abandon old patches in gerrit
* Support SSL parameters in security group tests
* Revert "[infrared] Ignore errors if tobiko-download-images does not exist"
* Update latest stable tag to 0.6.6
* [infrared] Ignore errors if tobiko-download-images does not exist
* [Stateless SG] Update test which creates stateful SG
* [Stateless SG] Add test to check creation of the stateless SG

0.6.6
-----

* Ubuntu tests use image\_file instead of image\_url
* Download ubuntu images prior to pytest execution
* WIP Add a skipper for Octavia client if it is missing
* Update latest stable tag to 0.6.5
* Run SSHGetL3AgentModeTest tests on Ubuntu Minimal instances

0.6.5
-----

* Configure Tobiko to skip swift containers health checks when Ceph RGW is deployed
* Move 'hard\_reboot\_controllers\_recovery' test to be run after the less disruptive tests
* [Stateless SG] Add test if new SG is always stateful by default
* [Stateless SG] Add test if default SG is always stateful
* [Stateless SG] Add constants and client functions for SGs
* Temporarily increate PYTEST\_TIMEOUT to 2400 on functional and scenario
* Partially revert "Removing the decorator 'flaky' from neutron and nova tests"
* Make ResourceTest tests stable
* Skip vips tests with load balancer
* Add possibility to choose python version in the pep8 job
* Add 30 sec after start\_agent
* Make test\_ping\_dscp stable again
* check whether test\_host is defined before checking if it is undercloud
* Fix openstack-tox-cover gate due to tox bump to tox4
* Removing the decorator 'flaky'
* Add timeout to all open\_session calls
* [BGP] copy /etc/hosts from the undercloud to the test\_host
* [infrared] install git before using it
* Make Tobiko to be working fine with packaging>=2.2.0
* [test] test\_trunk-limit the "ip address" command execution
* Add tox max version
* Check all control plane nodes are reponsive after rebooting them
* Update latest stable tag to 0.6.4

0.6.4
-----

* Faults workflows run sanity tests only once before disruptions
* Shelve name of tests using a heat stack
* Fix Octavia Active standby skipper
* Fix TripleO typo
* Remove use of Amphora FIP stacks
* Removing the decorator 'flaky' from neutron and nova tests
* [BGP] replace /home/stack by ~ in inventory file path
* [BGP] undercloud\_ssh\_key\_filename added to infrared plugin options
* [BGP] Fix test\_equal\_containers\_state
* [BGP] Fix ssh tunnel used to connect to podman socket
* [BGP] Add configurable overcloud\_groups\_dict
* Update latest stable tag to 0.6.3

0.6.3
-----

* Remove sanity tests from Octavia faults workflow
* doc: Fix spelling mistake
* Translate hostname to IP when the main\_vip is obtained
* Add roles/tobiko-run/vars/test-workflow-create-resources-faults.yaml
* Remove unit and functional tests from tobiko d/s gate workflow
* Fix octavia services test on jobs with networker nodes
* Update URL for flake8 from gitlab to github
* Pull flake8 from Github
* Add assert for haproxy service
* Add skippers to octavia-amphora ssh fault tests
* Update private key which should be used to sync github mirror
* Optimize get\_cmd\_pids and list\_pids methods
* Update github's deploy SSH secrets
* Skip test\_z99\_crash\_controller\_non\_main\_vip unless kexec-tools available
* Update latest stable tag to 0.6.2

0.6.2
-----

* Fix the problem with ss command line output parser
* Fix pylint errors with pandas 1.5.0
* Adapt main\_vip to pacemaker command output in case of IPv6
* Fix the exception raised during assert\_containers\_running method
* Skip test\_reset\_ovndb\_master\_container when OVN does not use HA
* Fix galera grastate faults tests
* Fix test\_reboot\_host\_with\_wait - wait after reboot
* Add test that verifies connectivity from computes to OVN DBS
* Collect unix socket information using existing ss module
* Remove "heat-admin" harcoded overcloud username from the code
* test\_check\_background\_vm\_ping: print all unreplied pings
* Create module to capture output of ss command
* Fix sphinx\_rtd\_theme in doc requirements
* Move OVN DB service model querier to trripleo module
* Don't skip 'test\_ovs\_bridges\_mac\_table\_size' test for OSP17.0 and above
* Add tobiko-upload-git-mirror job
* Use unsafe option in the pre-commit's check-yaml hook
* Remove test\_ovs module from the faults tests for neutron
* skip test\_1\_dvr\_router\_without\_server during verify-resources
* Update latest stable tag to 0.6.1

0.6.1
-----

* Redirect stderr of pcs resource enable/disable commands
* Verify RAFT DB inter-cluster communication
* Add basic RAFT health checks
* Enable OVN DB health checks when RAFT is enabled
* Modify test\_ovn\_dbs\_validations method to work with RAFT part2
* Update testing nodes to Fedora 36
* Modify test\_ovn\_dbs\_validations to support RAFT
* Configure limit of opened files for the test runner process
* Retry clonning the tobiko repository
* Remove subnet tests from test\_network
* replace the mariadb deamon for ops17
* Revert "Workaround to remove tests without name from xml report files"
* Fix RecursionError at class TripleoTopologyNode
* Skip ovn db bindings validations when ssl is used
* [RAFT] skip test\_ovn\_dbs\_validations when RAFT is configured
* [RAFT] adapt to changes in ovn-northd processes
* [IR plugin] Ensure auto ssh key exchange in the test host
* Reset tox\_env and other params for every test workflow step
* [Docs] Add new document about how to review changes
* Raise NoSuchKeystoneCredentials when credentials files are not found
* [RAFT] Fix OVN container names when RAFT is used
* Fix lower\_version: versions cannot be negative numbers
* Revert "Switch to Fedora cloud image version 35"
* Refactor Ubuntu image stack
* Run nested test cases as sub-tests
* Use a property to get undercloud key\_filename SSH parameter
* Add pytest-subtests plugin
* Remove Docker Infrared job
* Update OpenStack jobs
* Update Infrared jobs
* Update upper-requirements.txt
* Refactor Keystone integration tools
* Source /etc/profile before importing env variables from remote host
* Add tobiko setup document
* Test shiftstack tools only with active scifstack nodes
* No need to use sudo for looking for ip command
* Avoid using sudo for reading L3 conf file on localhost
* Ignore failure when showing last git commit details
* Do not fail when a certain python version is not available
* Update shell connection tools
* Update find command wrapper
* Pass tobiko project name when loading tobiko.log file
* Don't cache fixture name on classes
* Automatically pick ubuntu interface name on OSP-17
* Refactor tripleo skippers for checking RHOSP version
* Fix version regex to pick 'v\*' tags
* Add functions to parse tripleo RHOSP release
* Fix router namespace test
* Add tool to check overcloud version
* Integrate tool to parse versions
* Raise exception on errors parsing ssh\_config file
* Try connecting using SSH configuration before using IP addresses
* Switch to Fedora cloud image version 35
* Revert "Switch to Fedora cloud image version 36"
* Avoid setting up SSH connection when initializing it
* Switch to Fedora cloud image version 36
* Update Nova SSH key file fixture
* Workaround issue with disappearing namespaces on OSP nodes
* Add wrapper to which command
* Update latest stable tag to 0.6.0

0.6.0
-----

* Use regex to parse the output of ansible --version
* Use metalsmith instead of nova in test\_undercloud\_keystone\_session
* Fix ContainersHealthTest sanity tests in OSP17
* Fix SSH key filenames issues
* Add function select unique items from a sequence
* Use Metalsmith client to discover overcloud nodes
* Add sanity workflow for shiftstack project
* Add containers sanity test cases
* Add functions to list stack and stack resources
* Fix overcloud\_health\_checks on OSP17
* Remove redundant printing of tobiko execution output
* Fix PacemakerTest::test\_resources\_health on OSP17
* Fix test\_overcloud\_processes\_running on OSP17
* Fix finally verify\_osp\_version using packaging lib
* Add new Tox env for running shiftack sanity test cases
* Change default URL for testing Curl integration
* Add release note about metalsmith client support
* Enable tobiko debug logging messages by default in IR plugin
* Add OpenShift verification role
* Add skip\_unless\_undercloud\_has\_ansible decorator
* Add parameter for Nova client and short version in get\_server\_hypervisor
* Add Metalsmith client
* tripleo-ansible-inventory not supported in latest openstack releases
* Fix test\_fetch\_undercloud\_credentials on OSP17
* Open L3 agent ini file as root
* Allow to open file as root
* Fix overcloud SSH connection parameters
* Enable debugging messages in gate workflow
* Add function to ensure floating IP to shifstack nodes
* Add shiftstack.list\_shiftstack\_node\_ip\_addresses function
* Fix list\_device\_ip\_addresses and list\_port\_ip\_addresses functions
* Allow to specify heat client to FloatingIpStackFixture fixture
* Add get\_server\_id function
* Create functions to list for shiftstack nodes
* Make undercloud keystone credentials to be working with clouds.yaml
* remove general background ping skip since we have a specific skip decorator
* Skip ubuntu external tests on OSP17.0 and later
* [ubuntu images] make ubuntu interface name configurable
* Update OVS router namespace test cases
* Add a doc which will help tempest contributors
* Allow multiple yaml documents during pre-commit check-yaml validation
* Refactor Tobiko test run guide
* Refactor Tobiko configuration guide
* Refactor run tests part of Tobiko quick start guide
* Refactor configuration part of Tobiko quick start guide
* Skip topology functional test case in case has any Kyestone credentials
* Fix Octavia fault tests timeouts when SSH
* Get high level get\_l3\_agent\_mode topology function
* Add get\_l3\_agent\_mode function
* Update Shell connection tools
* Allow to parse io streams from open .ini files
* Skip test\_router\_is\_scheduled\_on\_l3\_agents when testing a distributed router
* Add unit test for parse\_ini\_file function
* Add function to help parsing .ini files
* Workaround to remove tests without name from xml report files
* Update get\_server\_hypervisor function
* Add tools to check namespaces on cloud nodes
* Add get\_ovs\_router\_namespace function
* Implement open\_file function in shell connections tool
* Update typing hints
* Fix RouterInterfaceTest
* Add skip background vm ping test capability as a decorator
* Fix Router network namespace test case
* Get clouds.yaml file for shifstack playbook
* Implement Ansible collections installation
* Create TripleO Ansible playbook functional test cases
* Make ansible playbook verbosity configurable
* Fix support for current\_dir parameter in ssh\_execute
* Update ensure\_router\_interface by using an Heat stack
* Update Neutron client
* Test minimal MTU value between external and internal network
* Add Sanity tests to test-workflow-check-resources-faults.yaml
* Fix has\_tripleo\_ansible\_inventory function
* Fix Octavia services test on new jobs
* Update systemctl wrapper
* Move TripleO ansible inventory file to .ansible/inventory folder
* Provision role files for playbook runner
* Add put\_files function to copy multiple files or directories
* Skip background ping until test is fixed
* Create a port for new router interface if gateway IP is already assigned
* Fix Amphora's SSH proxy creation
* Workaround multiuser git issue in Tobiko containers
* Increase Ubuntu Nova servers boot timeout
* Add systemd 'start unit' method
* Revert "Update to Fedora 35 image version"
* Set irrelevant files for docker-\* jobs
* Update to Fedora 35 image version
* Update to Ubuntu 22.04 LTS image version
* Bump paramiko version
* Fix neutron.ensure\_floating\_ip
* Create Amphora floating IP using a stack
* Move default router to external network stack
* Update Neutron client and its test cases
* Add sanity test cases to Octavia workflow
* Add Active/standby amphora fault tests
* Add quota option to tobiko IR plugin
* Test alive agents number is consistent over time
* Allow to explicitly define sleep\_time for retry loops
* Fix test runner
* Add systemd stop unit command
* Remove tobiko-infrared-centos-9 job for investigation
* Update user guide: subunit files are not generated by actual Tobiko test runner (PyTest)
* Fix typo
* Rename parameter from vars\_files to playbook\_files
* Refactor Octavia modules
* Fix error in debug-vars.yaml testing playbook
* python3-wheel is called python3-pip-wheel on rhel9
* Deploy var\_files before playing ansible playbooks
* Remote nova port notification test
* Add Designate Client unit tests
* Use nesterd virtualization nodes for tripleo-ci jobs
* Revert "Add new IR plugin option to specify test\_collect\_dir variable" Testing this for : https://trello.com/c/UmLsH0uS/644-fix-log-collection-in-tobiko-jobs
* Add support for Designate client
* Skip test\_nova\_port\_notification\_on\_activate unless has OVN
* Make stack cleanup task more robust
* Unify the location of InfraRed plugin test result files
* Add new IR plugin option to specify test\_collect\_dir variable
* Run Ansible playbook from undercloud node
* Put BackgroundProcess test in a individual test
* Add HA sanity test cases
* Add .pylintrc file and disable dict-values-not-iterating check
* Preserve stacktrace of round robin exception
* Fix Octavia services test
* Fix Octavia reboot amphora compute node test
* Temporarily remove voting flag from Docker py310 job
* Simplify actor sub-class declaration
* Refine interface for starting/stopping actors
* Add a workaround for octavia resources cleanup
* Make Actor class generic type
* Write background process tool
* FIX Background tests
* Move SFTP integration to connection tool
* Create a mew tool to help host connection type logic
* Use CentOS 9 on tobiko-tripleo jobs
* Move tobiko.shell.sh test cases to tobiko.tests.shell.sh
* Mark Python 3.9 and 3.10 as supported runtime
* Add wait method to PsProcess class
* Replave tobiko-tripleo-faults with tobiko-tripleo-minimal
* Add 'minimal' marker to pytest.ini file
* Mark minimal sanity test cases
* Move server creation/destruction test to sanity
* Run only minimal test cases with Tripleo jobs
* Use nested virtualization for tobiko-tripleo jobs
* pacemaker containers ignore when they change state since it is natural
* Mark as minimal only CirrosServerTest
* Add option to select test cases by markers
* Check credentials value is not empty before using it for OS Python client CLI
* Remove obsolete required\_setup\_fixture function
* Let RequiredFixture override propery class
* Add support for skip decorators on mixin and abstract classes
* Add ReporPortal PyTest plugin
* Select a new stable tag for donwstream jobs
* Remove version from the README file
* Revert "Move background ping to scenario test cases"
* Remove fedora 34 job
* Move background ping to scenario test cases

0.5.1
-----

* HA tests included in the faults-neutron workflow
* Migrate some test cases from scenario to sanity test suite
* Remove obsolete devstack-tobiko-ceph template
* Run os\_tempest role to create missing resources
* Run tox by module name (python -m tox)
* Generate SSH keys on the first host in the inventory
* Fix tobiko-ensure-ssh-keys to work out of Vagrant
* Retry creating stack when quota fail to ensure quotas
* fix nonexistent tobiko-fixup-stuff role
* Test migration without block\_migration parameter
* Ignore errors including tobiko-fixup-stuff role
* Update lower constraints file
* Move TripleO job implementation to zuul.d/tripleo.yaml
* Prefer using ECDSA over RSA as SSH key type
* Add support for DSA, ECDSA and Ed25519 key types
* Fix infrared-centos-8 job
* Update supported OSs
* Update Vagranfile used to test infrared plugin
* Add voting to tobiko-infrared-centos-9 job
* Test Tobiko IR plugin with CentOS 9
* Revert "Drop CentOS support for InfraRed plugin"

0.5.0
-----

* Remove broken test case for podman integration
* Drop CentOS support for InfraRed plugin
* Remove obsolete jobs definitions
* Fix typo in Curl integration
* Enforce stack re-creation attempt when can't ensure nova scheduler hints
* Ignore named report files .gitignore
* Allow containers to write to ~/.ssh
* Update fixture module typing hints
* Update NetworkTest cases descriptions
* Use Fedora 34 for the lower-constraints and Infrared containers
* Ensures server instance exists when validating its stack
* Add typing hits to Nova client
* Fix same/different host network tests
* Delete stack when its detected to be invalid
* Update Nova client error handling
* [IR plugin] source dir should be found on localhost
* Skip test\_server when not valid host for migration is found
* Add git describe output to HTML report file
* Fix AttributeError: 'ParseResult' object has no attribute 'rsplit
* Mark test\_serve.py test cases as flaky
* Revert "Mark test\_curl.py tests as flaky"
* Mark test\_port.py test case as flaky
* Handle maxfail pytest option from InfraRed plugin
* Check project using basic ARM64 functional job
* Mark test\_trunk test cases as flaky
* Revert "Gate project using basic ARM64 functional job"
* Skip flaky test cases with IR plugin
* Mark test\_router\_is\_scheduled\_on\_l3\_agents test case as flaky
* Run the tobiko-docker-py3 job only on gate pipeline
* Mark test\_curl.py tests as flaky
* Mark test\_qos test cases as flaky
* Refactor Tobiko installation guide
* Gate project using basic ARM64 functional job
* Mark test as flacky OvercloudHealthCheck.test\_controllers\_shutdown
* Use default value specified for tobiko.conf when --debug option is not given
* Fix bindeps installation on CentOS
* Update bindep file to support Debian Linux
* Add default\_timeout parameter to ubuntu stack
* Restructure Octavia stacks
* Update tobiko.conf documentation page
* Speedup documentation page generation
* Update README.rst file
* Fix typo in InfrRed spec file
* Ignore HTML report files
* Deploy OpenShift InfraRed files from Tobiko InfraRed plugin
* Change TCP port number used in the unit tests
* Use Fedora Linux to gate changes with the infrared plugin
* add backround ping during disruptive actions
* Add review.opendev to README References
* Check container on top of arm64 architecture
* Fix EnsureQuotaLimitsTest test case
* Install docker-compose using pip
* Update mypy linters hook
* Fix linters type check
* Update run\_tests.py environment variable names
* Use Fedora 34, Fedora 35 and CentOS 8 as base container images
* Update Tobiko container
* Run Openstack Yoga unit test jobs
* Add support for Python 3.10
* Stop setting locales in Dockerfile
* Update mypy hook to v0.930
* Let tobiko-infrared-fedora job vote
* Stop setting locale env variable in tox
* Add new use\_fixture function
* Update tobiko/common/\_testcase.py module
* Update the RHEL\_IMAGE\_MINOR\_VERSION
* Add skip\_on\_error decorator
* Update tripleo containers check if ceph-rdw
* Fix cuncurrency problem in wait\_for\_cloud\_init\_status function
* Make datetime format in log files to be configurable
* Let requirements-check job vote
* Skip systemctl functional tests when systemd is not running
* Add Dockerfile to Infrared plugin
* Fix problem with setuptools and newer pythons
* Collect report files from docker jobs
* Skip test when systemctl command is not available
* Create a job to run Tobiko tests from a Docker container
* Update docker configuration files
* Fix Docker Compose file
* Gate project with devstack-tobiko-octavia job
* Update upper constraints file
* Update pre-commit hooks configuration
* Create sanity workflow
* Add "--always" option to the git describe command in tools
* Add copyrigths header to HA faults test cases
* Revert "Run faults jobs"
* Run sanity test cases in gate workflow
* Run sanity test cases in faults workflow
* Create first dummy sanity test case
* Run faults jobs
* Use TestSuite and TestResult
* Use ubuntu servers as LB members
* Update wait\_for\_cloud\_init\_status function
* Improve required\_fixture typing
* Use is\_reachable\_timeout for checking for cloud init status
* Enable port security on default tenant network
* Disable VLAN port routing for Ubuntu Nova servers
* Improve trunk port test case
* Fix Octavia round robin traffic test error
* Update trunk test
* Debug list endpoints errors
* Udate floating IP test case
* Rerun flacky functional test cases
* Gate tobiko using Octavia OVS job
* Fix traffic test - add curl timeout error
* Fix unexpected argument timeout on LB waiters
* Update Octavia OVN SSH traffic test
* Add test runner script
* Make tobiko-cleanup role not to stuck at stack deletion
* Add tool to list test cases
* Run Tobiko functional test cases
* Refactor OVN traffic test
* Revert "Remove voting from requirements-check job"
* Add Octavia OVN provider scenario test
* Add Octavia round robin waiter & exception
* Add functions to list and find floating IPs
* Make health monitor resource creation to be conditional
* Revert "Temporarly disable devstack jobs"
* Disable Fodora image based test case cause of internet connectivity issues
* Remove tobiko-infrared\* jobs from project requirements
* Revert "Add workaround for the race between creating rooter and booting vm"
* Temporarly disable devstack jobs
* Add workaround for the race between creating rooter and booting vm
* Refactor container files
* Spawn member servers on VIP network
* Fix Octavia no 'loadbalancer' AttributeError
* Handle file removal concurrency
* Set default test path for the run\_tests script
* Revert "Restore live migration tests"
* Add Active standby support
* Refactor Octavia waiters module
* Fix Octavia test\_traffic instability
* Increase CentOS servers 'is-reachable' timeout to 15 minutes
* Stop running faults test cases after the first failure
* Update wait\_for\_octavia\_service function
* Fix Octavia service unavailable error
* Restore live migration tests
* Remove requirements project deployment from DevStack role
* Fix test\_wc
* Remove six from project dependencies
* Add podman 1.6.0 source files and update requirements
* Use local upper-constraints.txt
* Remove count\_members variable from octavia tests
* Restore Octavia jobs voting flag
* Pick version 0.4.10 as default stable tag
* Add create-resources-neutron and check-resources-neutron workflows
* Mark test\_traffic as flacky

0.4.10
------

* Use safe loader/dumper to load/dump YAMLs things
* Use tobiko curl module in Octavia validators
* Add Octavia OVN provider support
* Replace job template devstack-tobiko-glance with devstack-tobiko-storage
* Disable Trunk ports from the QoS stack
* Run devstack-tobiko-nova jobs
* Increase timeout for assert\_is\_reachable method up to 10 minutes
* Fix Tripleo reboot method
* Gate tobiko using devstack-plugin-heat jobs
* Add new flag cleanup-heat-stacks to the infrared plugin
* Remove devstack-tobiko-faults jobs
* Trigger the new devstack-tobiko-neutron jobs
* Update curl.execute\_curl function
* Create Heat's workflows
* Update Nova Server test
* Wait for iperf3 server to be active before testing BW
* Fix test\_infrared\_plugin.yaml playbook
* Add floating IP to loadbalancer stack
* Allow to specify load balancer provider type
* Allocate 256MB of Ram for Ubuntu VMs
* Skip OctaviaBasicFaultTest.test\_reboot\_amphora\_compute\_node on upstream CI
* Workaround pylint issue with python3.6
* Remove ansible-lint from linter requirements
* Use older constraints file for linters requirements
* Add Octavia compute node failover fault test
* Add a reboot overcloud node method to tripleo topology
* Rename module: tobiko.common.\_asserts -> tobiko.common.\_fail
* Update overcloud shutdown procedure
* Add tools to edit user-data server parameter
* Set a default password for the ubuntu customized image
* Wait for clout init to finish setting up network interfaces
* Export typing for TestCase class
* Add Octavia faults workflow
* Moves RTD theme requirements definition
* Remove voting from requirements-check job
* Regenerate HTML report files after any test case execution
* Use tobiko own config options to configure logging
* Allow to disable networking extensions
* Increase pytest command verbosity
* Add check-resources-nova and create-resources-nova workflows
* Fix VlanServerStackFixture.list\_vlan\_fixed\_ips when has any IPs
* Update sphinx\_rtd\_theme version to the 1.0
* Use Ubuntu server with a working trunk VLAN subport
* Raise default stack retry count to 3 and max interval to 5
* Raise logging message for stacks found in \*\_FAILED state
* Allow to specify device name when listing host IP addresses
* Improve test\_neutron\_agents\_are\_alive on cloud recovery
* Revert "Increase timeout for ironic power-on and power-off operations"
* Add PyYaml to project requirements
* Increase timeout for ironic power-on and power-off operations
* Set the new stable release as 0.4.9
* Update test\_trunk
* Add assert\_is\_[un]reachable methods to ServerStackFixture class
* Add support for password assignation on customized images

0.4.9
-----


0.4.8
-----

* Revert "Get required fixture even from owner object type"
* Move Skip check to setup on Octavia services test
* Make test case NeutronLogCliTest supporting all configurations
* Add CLI tests for security group logging
* Update typing for ip module
* Fix retry count=0 issue when creating new stack
* Allow TestFloatingIPLogging on 16.1 and higher
* Fix reason for skip\_unless\_missing\_networking\_agents decorator
* Fix a typo in the contributor guide
* Exclude detection of leaked OVS resources on undercloud node
* Allow selecting nodes by group name regular expression
* Fix default documentation page URL
* Do not retry to create a stack forever
* Fix OvercloudServicesTest for OSP 16
* Add decorator to skip test in case when DVR router is used
* Skip Centos7 test cases
* Skip broken L3haDifferentHostNetworkTest
* Add Octavia's main services manipulation test
* Add decorator to skip tests if TOBIKO\_PREVENT\_CREATE is True
* Make test\_router\_is\_scheduled\_on\_l3\_agents compatible with dvr routers
* Set default stable tag to 0.4.7
* Get required fixture even from owner object type
* Mark test\_trunk\_fip\_after\_reboot as flaky
* Add --overcloud-ssh-username option to Tobiko InfraRed plugin
* Fix get\_overcloud\_node\_services\_table function
* Add list\_systemd\_units function
* Add test\_extra\_dhcp\_opts\_logs\_unsupported\_options
* Add initial trunk test

0.4.7
-----

* Fix triple-o ansible integration
* Fix cirros get img timeouts
* Skip re-downloading files if maching file size
* Fix test\_topology for triple-o
* Create make\_remote\_dirs function
* Add function to check file size
* Add function to create a temporary directory
* remove ps -ef clutter from CI jobs logs
* Add download\_file and get\_file\_size functions
* Add get\_url\_header function to curl package
* move default tobiko install to new stable tag 0.4.6
* Create curl package
* Show error message content when HTTP requests fails
* Fix attribute error (stack.name -> stack.stack\_name)
* Disable stdout decoding to stream when reading Tcpdump file
* Add extra-dhcp-opts test
* Trigger DevStack minimal jobs
* Run special devstack-glance jobs
* Remove RequiredSetupFixtureProperty class
* Setup required fixture by default
* Deprecate tobiko.required\_setup\_fixture
* Add functional test for sh.process function
* Skip test cases unless RHEL image is available
* Mark test\_ping\_dscp as flacky
* Use kill command to kill local processes when sudo is required
* Increase stack creation timeout from 300 to 600 seconds

0.4.6
-----

* Fix is\_docker\_running function when dockerd is not running
* Add kill method to PsProcess
* Add tool to list cloud nodes processes
* Remove CirrOS HTTP server fixture
* Add timestamp to the NeutronNovaResponse object
* Revert "W/A for zull gate issue Unable to freeze job graph"
* move default tobiko install to new stable tag

0.4.5
-----

* W/A for zull gate issue Unable to freeze job graph
* disable osp13 docker api common container checks
* Fix container names in container objects for osp13
* Fix issue with docker when running faults tests
* Fix issue when parsing podman/docker version output
* Fix containers runtime discovery
* Avoid getting container details when listing containers
* Call overcloud\_health\_checks in test\_controllers\_shutdown
* Update Ironic wait\_for\_node\_power\_state function
* Failback on Nova APIs when Ironic one fails for powering on/off overcloud nodes
* Fix action\_on\_container function
* Revert "Use Ubuntu server instance as octavia members"
* Add tcpdump support and verify DSCP marking in QoS tests
* Use Ubuntu server instance as octavia members
* Retry neutron agent list requests upon any exception
* Use the new DevStack plugin Zuul templates
* Add simple functions to check if neutron is configured with OVN or OVS

0.4.4
-----

* Remove quota handling from tobiko-configure role
* Add SharedFixture.fixture\_id property
* Refactor QoS test case
* Skip QoS test cases in case it is all OVN (OSP-13) configuration
* Update test\_select
* Create skip\_if\_is\_old\_ovn decorator
* Allow to select objects using regular expressions
* Use ast.literal\_eval to parse Nova responses
* Create tobiko-infrared zuul template
* Make the reboot controller tests come last
* Fix ensure\_nova\_quota\_limits
* Fix ensure\_neutron\_quota\_limits
* Remove OSP specific assumptions in test\_neutron\_agents\_are\_alive
* Stop using OSP related assumption in non-osp test cases

0.4.3
-----

* Move Neutron agents stuff from neutron/\_client.py to neutron/\_agent.py
* Ensure tobiko package directory is not in the sys.path
* Make the crash tests come last
* Update networking quotas before creating network stacks
* Update Nova functional test case
* Update Heat template fixture
* Update Heat stack fixture
* Update Nova client
* Create workflows for OVN migration
* Update port logging test case
* Add buzilla parameter to skip decorators
* Add Neutron Nova response reader
* Add Selection.last property
* Update typing hints in log digger tools
* Mantain read line ordering
* Fix RetryAttempt.is\_last method
* Fix test\_ovs\_objects\_are\_absent\_on\_node test
* Update CirrOS image version to 0.5.2
* Fix galera and rabbit kill commands
* Add healthmonitor to Octavia
* Avoid running 'commands\_pre' in 'bindep' tox envinvironment
* Add option to skip all remaining test cases after a given timeout is expired
* Accept yaml format for --tox-enviroment Infrared plugin option
* Switch to RHEL 8.4 image version
* Switch to CentOS 8.4 cloud image
* Allows to check a maximum number of agent pids has been found
* Add retry attempt property to check if it is the last aptempt
* Change test\_stop\_dhcp\_agent to test\_restart\_dhcp\_agent

0.4.2
-----

* Check if vms are reachable before migration test starts
* Revert "pidone: ban resources (redis and ovn-dbs) and check another resource is"
* Fix ShellReadable.read method when resulting chunk is None
* Fix problem with PS1 env variable expansion
* Add caching mechanism to get\_hostname function
* Update nova quota APIs
* Get user/project it from built-in method
* Add neutron quota APIs
* Add typing hints to Heat client APIs
* Add support for ~ shell special character
* Use ping.assert\_reachable\_hosts function to ping hosts
* Test ip and ping commands against Fedora server
* Fix assert\_reachable\_host function
* Replace CentOS server with CirrOS server in functional test case
* Add support to Fedora 34 base cloud image
* Add image customization options
* Load key files manually before making SSH connections
* Improve Ubuntu server boot performance
* Allow to specify commands to be executed at first VM boot
* Remove advanced L3HA Nova servers
* Update shell command join and quote methods
* Fix podman client integration
* Skip live migration test
* Correct the tox option for skipping sdist generation
* Fix problem when making SSH connection to IPv6 IP address
* Restore "Add new scenario test cases for live migration""
* Unlock CI pipelines
* Add CentOS 7 cloud image support
* Check tobiko infrared works on Fedora 34 by the check pipeline
* setup.cfg: Replace dashes with underscores
* Switch fedora-latest to use fedora-34
* Require DHCP to be disabled on external subnets
* Fix get\_hostname function
* Add ncat to the ubuntu image
* pidone: ban resources (redis and ovn-dbs) and check another resource is promoted
* Use full ubuntu image for testing external networks (to have ping installed)
* Fix external networks scenario test cases
* Remove CentOS and CirrOS external network servers
* Revert "Workaround for HOME env variable expansion problem in validations-libs 1.2.0"
* Update docker client
* Workaround for HOME env variable expansion problem in validations-libs 1.2.0
* Move validations-lib to core requirements
* Update type hints for ps tool integration
* Add type hint to ShellProcessFixture.execute method
* Add Selection.select method
* Fix typing hints for topology connection module
* Use UTF-8 encoding when reading SSH config files
* Discover controller and compute nodes only when has keystone credentials
* Add type hints to fail function
* Update shell command tool
* Add tool to connect to a remote unix socket
* Fix default shell for command execution
* Allow to specify an exception as cause in skipping reason details
* Use NGIX HTTP server for testing curl integration
* Update tobiko shell package
* Remove podman unit tests
* Restore CentOS 7 infrared job to test Podman 1.6 integration
* Ignore pylint error in test\_proxy
* Add initial post OVN migration test
* osp16.2 >= icorporate podman-py api usage podman\_ver3, where needed
* Fix bug in conftest script
* Fix podman1 installation
* Use virt-customize as regular user
* Let rename old podman varlink package as podman1
* Revert "Add new scenario test cases for live migration"
* Ignore failures on powering on overcloud nodes when discovering them
* Add new scenario test cases for live migration
* Remove unnecessary wait\_for\_cloud\_init\_done operation
* Fix problem in cloud-init integration when no log file is writen yet
* Improve subnet debug message
* Increas Nova service wait timeout
* Add scenario test case to verivy Nova servers migration
* Fix issue when noise neaks into get\_python\_info.py script stdout
* Use Ubuntu minimal image to run Iperf3 server
* Increase the wait for cloud-init timeout from 10 to 20 minutes
* fix : || export podman\_service=podman.socket && test -e /lib/systemd/system/io.podman.socket || export podman\_socket\_file=/run/podman/podman.sock &&
* Improve cloud-init debugging traces
* Ensure server is running before getting console
* Update cloud-init integration
* Revert "Test quorum number of controller nodes hard shutdown"
* Add ssh\_client option to Octavia validators module
* Fix for podman-varlink io.podman.socket': No such file or directory
* The BZ1542122 is fixed and now the test shouldn't be skipped
* Test quorum number of controller nodes hard shutdown
* Test quorum number of controller nodes power on/off
* Use Ironic undercloud APIs to power on/off Overcloud nodes
* Create bw limit qos test
* Waiting for stack deleted completely at fault tests cleanup (II)
* Waiting for stack deleted completely at fault tests cleanup
* Integrate Ironic client
* Wait until stack deletion is completed at test cleanup
* Change the path where working Iptables will be saved, in case of Network Disruption, from '/root' to '/home/heat-admin', so that it could work for compute nodes as well (currently,  network disruption on Instance-HA (OSP13) is ignored)
* Generalize and refactor Octavia waiters module
* Fix grep\_files when some file doesn't match given pattern
* Wait for new lines to be logged out before checking for event
* Add proxy\_jump host to topology nodes discovery
* Remove direction property from QoSBandwidthLimitRule Heat template
* Update tobiko-infrared jobs
* Fix install-bindeps.sh to work without sudo
* Install iperf3 tool on tests tobiko host
* Cloud recovery tests skip overcloud validations before disruption
* Create the first qos basic test
* Fix ovn\_dbs\_vip\_bindings for old OSP releases
* Remove test\_nova\_port\_notification\_on\_shutoff
* Add neutron-ovn-metadata-agent entries to TripleoTopology dictionaries
* Skip ping tests when instance does not support ping command
* Fix "raise error in case of timeout" task from tobiko-tox role
* undercloud\_ssh\_hostname should include FQDN suffix
* Refactor call proxy class generation
* Implement base actor class
* Implement call proxy handling

0.4.1
-----

* Fix ovn metadata service name in Devstack deployment
* Force failure when test execution times out
* Ensure that VM needed by the OvnController faults tests really works
* Crash controllers that don't hold an overcloud main VIP
* Try to use either docker or podman to obtain nova version
* Update pre-commit hooks versions
* Set undercloud\_ssh\_hostname on tobiko.conf
* Separate listener and pool stacks
* Update PyLint version to last valid tag for Python version >= 3.8
* Test external port using Ubuntu minimal image
* Allow to specify empty value for tripleo.undercloud\_ssh\_hostname option
* Create Tobiko Contributor Guide
* Add Ubuntu Minimal cloud image
* Unmark test\_router\_is\_scheduled\_on\_l3\_agents as flaky
* Revert "Ignore L3HA router having multiple master agents"
* Add support for modified\_since parameter to find command
* Test CentOS Nova server with external network
* Add debug logs to determine when a heat stack is deleted/created
* Fix neutron nova port notification tests to check logs on controllers
* Fix conflict with astroid python library
* Remove installation of tobiko in the doc/source/conf.py file
* Check LB "provisioning\_status" and improving Netcat Cirros HTTP stub
* [docs] Made additional updates to Tobiko documentation
* Stabilize ExternalPortTest.test\_port\_ips
* [docs] Updated quickstart guide and example conf file
* Accept external networks withouth DHCP
* Gate changes using the default faults job
* Ignore L3HA router having multiple master agents
* Fixed typo in README
* Test crash controller main VIP
* Scatter Octavia's test logic to tobiko framework
* Use tobiko 0.4.0 as default version for Downstream jobs
* Remove duplicated get\_osp\_version method

0.4.0
-----

* Add support for 'crash' reboot method
* Update pytest reports generation
* Fix test\_router\_is\_scheduled\_on\_l3\_agents test
* Mark flaky tests
* Generate legacy junit XML file
* Gate Tobiko projects running faults test cases
* Update Nova server APIs an
* Fix reboot when target host si not reachable
* Fix OVN test\_agents running on devstack environments
* Pick the first tester, undercloud or tempest node from inventory
* Fix greping of the journalctl log for neutron notification line
* Workaround Tox problem due to rarely defined PS1 variable on OSP installations
* Remove itimer utilities
* Remove last dependency from stestr
* Use pytest-cov plugin for getting coverage
* Use pytest timeout and log capturing
* Rerun test cases of the last verification step
* Test floating IP attach/detach logs
* Wait for L3 agents to be configured as master/backup
* Fix port logging test case
* Update log digging APIs
* Include all project requirements in doc/requirements.txt file
* Fix builds of the sphinx docs
* Temporarily replace compute hard reboot by soft reboot test due to BZ1890895
* Make ping asserts more patient when waiting for expected condition
* Add known ping.UnknowHostError case
* Wait until ping message is returned after migration
* Execute only one infrared job on check and gate pipelines, all of them on periodic
* Pidone: galera test - request sst upon shutdown
* Test that no router namespace is created for DVR on compute node
* Add OSP version skip decorator
* Use devstack-tobiko-gate jobs from its project template
* Add CirrOS based HTTP server stack
* Let lower-constraints job not using upper-constraints file
* Properly skip Metadata tests in deployment without containers
* Add curl command integration
* Add check requirements job
* Update requirements
* PIDONE: grastate galera tests
* tobiko IR version : set default execution version to 0.3.1 tag
* Minor code improvements
* Grep commands output using grep on remote host
* Use config drive in the vm plugged directly to the external network
* Switch to pytest test runner
* Use the new DevStack gate jobs
* Add workflow for gating tobiko changes

0.3.1
-----

* add all vm running virsh check
* Checking mac-table-size only on nodes where it is possible
* Restore DevStack functional and scenario jobs (Ubuntu)
* Pass broken jobs with Python 3.8 (Ubuntu Focal and Fedora 32)
* Skip often failing SameHostNetworkTest and DifferentHostNetworkTest scenario test cases
* Update framework before switching to pytest
* Add RedHat 8.2 server instance
* Pass OVN functional job on upstream CI
* Fix --tobiko-refspec option in IR tobiko plugin
* Copy default nameservers from external network
* Fix/refactor PortTest
* Add JournalLogDigger class to parse OpenStack services logs
* Fix test\_get\_stack
* Fix pylint problem with Python 3.9
* Change 'get\_main\_vip()' function so that it could treat both ipv4 and ipv6 addresses
* Correct some typos in test\_port.py
* Gate changes using devstack-tobiko-functional-ovn-centos job
* Gate changes using devstack-tobiko-scenario-ovn-centos job
* Update documentation
* Get IR from master branch version
* Fix OVN DB verifications from ovn\_dbs\_are\_synchronized

0.3.0
-----

* Skip test cases unless external network is available
* Drop python3.7 platform in favor of phython3.9
* Fix skip of faults OVN agents tests when there is no OVN in env
* Test opening ports on an external network
* kill all galera processes
* Increase the number of ping packages sent to nameservers
* Openstack CLI tests failed on devstack
* Add swap file to Ubuntu servers
* Reduce memory assigned to CentOS servers to 256MB
* Switch tripleo job to content provider
* Verify network agents are alive when tests end
* Skip python3 package installation on CentOS servers
* Reduce Ubuntu Server memory to 256 MB
* adding messaging node possibility
* gitignore add .idea
* Add verification of mac-table-size values
* Check OVN DBs listening on VIP (BZ1600151)
* Use tobiko host nameservers for tenant subnets
* Add functions to create and delete a network
* Add function to list remote host nameservers
* Gate changes using the scenario single-node OVN job
* Use Ubuntu Focal cloud image
* Add platform python test case for CentOS VMs
* Fix how OVN process validations filter node names
* Check and gate project using CentOS
* Add get\_keystone\_token and get\_keystone\_endpoint functions
* Add type hints to keystone package
* Fix shell execute
* Increase default connection timeout for CentOS VMs from 400 to 800 seconds
* Avoid retrying an invalid SSH key\_filename twice
* Add openstack client tests
* Add some OVN containers recovery tests
* Fix connectivity issue during external bridge recreation test
* Skip OVN tests when OVN containers do not exist
* Add OVN DBs synchronization validations
* Improve ping integration error handling
* Fix test\_ping
* Update requirements: sshtunnel>=0.2.2
* Add container configuration validations to faults tests
* Add OVN processes validations to faults tests
* Fix shell command to string method
* Refactor log files digging
* Add multinode faults OVN jobs
* Allow to specify a per-image SSH connection timeout
* Add scenario OVN jobs
* Refactor neutron agent fault tests
* Add OVN metadata and OVN controller tests to test\_neutron\_agents
* Regenerate ssh port forwardings for docker after controller reboot
* Disable centos jobs from check pipeline
* Gate projects using Ubuntu Focal
* Fix service start/stop in neutron agent tests to support OSP13
* Test nova to neutron port notification
* Confirm node is rebooted when reboot command is sent
* Fix testenv use of posargs in tox.ini
* Fix ovn-controller binary value
* Reduce test\_ping\_subnet\_gateways duration when it fails
* Check only running containers on assert\_containers\_running
* Test VM reachability when metadata agent is down
* Connect to TripleO cloud via its hypervisor host
* Add typing annotation to selection tools
* Fix neutron agents faults tests
* Get node service name by Neutron agent name
* Skip tests when neutron agents are missing
* Define neutron agent service names
* Add TOX\_PYDEV\_DEBUG env variable to run\_tests.py
* When creating a network disruption we should use DROP
* Set a proper ordering when calling iptables
* Replace podman by docker to run commands
* Wait for metadata agent status change in matadata agent test case
* Test keepalived failover and operation after l3 agent restart
* Fix find\_msg\_in\_file method to search in active log file only
* Add devstack-tobiko-\* jobs
* Remove DevStack support from tobiko repository
* Add faults test which destroys and creates physical bridges
* Update InfraRed requirements file
* Use the overcloud host-config before than the one from the global host-config
* Identify node by its hostame when SSH client is provided
* Add a timeout for workflow stages
* Fix topology discovery via proxy clients
* Clean up multiple exception handling from stack traces
* Handle SetupError exception to avoid spamming into log files
* Fix container format assignment to the right variable
* Use only IP address to SSH overcloud nodes
* Update IR patchset version
* Switch to IR Fedora job to Fedora 32
* Remove Ubuntu Bionic jobs
* Fix CirrOS image default configuration and switch to 5.1 version
* Implement Nova Server migration tools
* Refactor topology nodes discovery
* Skip functional test cases requiring Keystone credentials
* Test neutron log files rotation
* Check Neutron list agents returns empty value with OVN and OSP13
* Fix SSH client configuration
* Install python3 from correct repo with rhosp-RedHat-7.9 setups
* Add skip method for missing Keystone credentials
* Check if log files exist in containers and can be accessible from node
* Move Neutron agents health check to OpenStack tests
* Add metadata agent restart test
* Ensure Nova server status is ACTIVE/SHUTOFF before testing reboot
* Add container configuration files test
* Increase ping timeout to 5 minutes
* Pass retry limits when creating SSH connection
* Restore voting to tobiko-devstack-functional-centos-8 job
* Let tobiko generate its own SSH key
* Make pacemaker test cases skip verification lazy
* Add centos-7 support
* Ensure python-docutils package is installed
* Remove voting from failing jobs
* InstanceHa seperate from HA tests
* neutron agents healthcheck timeout 60->300
* Refactor reboot host operation
* Improve error reporting when fixture initialization from class fails
* Unbind floating IP test case from reboot host operation
* Use retry tool for shell process synchronization
* Configure CI test cases timeouts
* Allow to configure a timeout for test cases execution
* Create timer tool based on SIGALARM signal
* Fix pylint errors (raise-missing-from)
* add workflows create and check for octavia specific test scenarios
* Update time tools
* Use default timeout for SSH reconnection when executing command
* Re-connect to SSH server when connection is broken
* Check every server ID is unique and new after server creation
* Retry flaky test cases pinging inner router
* Remove duplicate exception tracebacks from test reporting
* Write traceback on failed retry attempts
* Add timestamp, level and modulename to the format for capture log
* Refactor testcase module
* Use default logging format in Tobiko logs
* Directly use \_overcloud and \_undercloud private names from topology.py
* Improve retry APIs
* Try multiple tripleo RC files for OS credentials
* make 0vercloud\_health\_check the first to run
* Use retry tool for waiting for healthy Nova services
* Create retry tools
* Create time tools
* server stack creation : leep for 20 sec , ensure no race condition with ssh
* pacemaker - increase timeout - some envs take longer to recover
* fix workflow check resources faults into a dict
* test\_servers create : wait 5s between vm creation and ssh to avoid race condition
* InstanceHA skipp ping for shutdown vms test
* assert\_all\_tripleo\_containers\_running remove clustercheck This is a w/a to unblock composable roles jobs future fix will do conditional conrainer checks based on topology nodes
* Remove -j0 option from pylint pre-commit hook
* put evac image into maintanance untill we add a logic to delete evacuable image if any failure
* cirros 0.5.1 is doesnt boot switch to 0.4
* Fix test\_network\_disruptor\_main\_vip: wait for pcs failure after disruption
* add check-resources-faults check for post upgrades/updates checks
* delete evacuable tagged image because it prevents non tagged evacuations if exists This is so that the other IHA tests won't fail
* Retry creating remote SSH process on SSHException
* Enable logging debug lines by default in infrared plugin
* Fix pre-commit hook Git urls
* increase pacemaker timeout and limit pcs output to reduce false negatives in checks
* Fix SSH forwarder cleanup
* Enable logging debug lines in devstack jobs
* Reconnect SSH client when found in broken state
* Offers some revisions to quickstart guide
* Return dummuy test case in case not in one
* update for timeouts longer in faults, reduce false negatives
* tripleo validations output and log passed validations
* pacemaker table get now with time limit
* Delete server stacks after testing server creation
* Capture Validation lib exceptions
* Add nova tox env to run nova scenario test cases
* Add test cases for nova server creation
* Allow to get current test case
* Add tools for getting ansible inventory
* Properly namespace nodes
* Fix tripleo-validations : roles not found
* unblock CI - comment out non-main vip network desruption test
* Replace tabs with spaces in linters-requirements.txt
* Use --allow-missing-config for installing pre-commit hook
* tests/faults remove duplicate hard reset all controllers
* Use pep8 venv for pylint pre-commit hook
* Use last IR version when running with Python 3.8
* Fix irrevelant files for IR jobs
* Workaround infrared setup failures
* Use InfraRed master version for RHEL 7
* Add ansible-lint pre-commit hook
* Add pylint pre-commit hook
* Add mypy pre-commit hook
* Add flake8 pre-commit hook
* Introduce pre-commit hooks for linters verifications
* Fix ansible-lint failures
* Add support for fixture\_id to stack fixtures
* Add fixture\_id parameter to allow multiple fixtures of the same class
* Cleanup ssh\_client connection before deleting stack
* Ensure heat client is available before getting stack status
* Fix test\_ifconfig
* Disable horizon service in local.conf for Vagrant
* Avoid sudo's 'secure\_path' value from affecting stack.sh/unstack.sh scripts
* Fix build of tobiko docs
* Disable tempest service in local.conf for Vagrant
* make network disruptors skipp if no fencing deployed on overcloud
* make sure all iha tests are run only if iha configured
* comment out/put network\_disruptions in maintanance , unblock testing
* Fix tobiko-devstack role
* Fix copy of local.conf (permissions escalation)
* Rename Tobiko's three nodes nodesets
* Switch to CentOS image version 8.2
* Set CentOS-8 as reference DevStack job
* Skip faults OVN tests when OVN is not used
* Declass Pandas as an extra optional requirement
* Add extra-requirements to lower-constraints tox environment
* Test IR plugin only against latest Fedora version
* Disable sibilling projects installation on CentOS 7
* Fixes minor typo in installation guide
* method addition:remove\_containers\_if\_pacemaker\_resources to not fail on pacemaker resources in assert\_equal\_container\_state
* All VM instances need to be started after computes reboot
* Set default log to non debug, currently debugging tests is very difficult I really can't figure out where the test failed and what actions tobiko did each test should be verbose enough so that new users will not spend more than 5 min in tobiko logs , to figure out what broke
* unblock testing, dont fail on assert\_containers\_state until we fix the check
* faults instance-ha tests create only 2 vms to not stress the overcloud
* Ensure stack is deleted before creating it again
* Rewrite Vagrant file using ansible and Centos 8
* Retry mechanism for check\_neutron\_agents\_health
* Update role tasks to reduce false 'changed' state
* Update .gitignore file
* Handle non-RHOSP hosts without rescueing from an error
* Add tripleo validations (post-deployment group checks) to overcloud healthchecks
* add IHA tests Change-Id: I8d2740e877c607c3b225dd3475b4abc6f3420378
* Clear cache before retrying to get containers info
* Update Dockerfile to use bindep and tox
* Update the quickstart guide
* Add validations-libs as an extra requirement
* Add lower-contraints job
* Obtain overcloud nodes know subgroups from node name
* Added skip decorator to test\_metadata\_haproxy\_during\_stop\_L3\_agent test
* restart ovn faults tests
* Add tool to install bindeps
* Fix number of columns obtained from PCS output
* remove duplicate /failing container tests
* Update Quick Start guide
* Update project README.rst file
* Update zuul irrelevant files
* Use special RHOSP vars files in tobiko-ensure-python3 role
* Delete IR workspace before importing new one
* Automaticall use Python 3.8 IR patch when required
* Add support for tags at image creation
* Add py3 prefix to Python 3 platform vars files
* Fix rhel optional repo not found and not reported as error
* add test\_sequentially\_hard\_reboot\_controllers\_recovery test
* Enable rhel-7-server-optional-rpms repo
* faults add network disruptor disruptions to main vip tests
* Enforce using compiled python release on RHEL-7 by pinning 3.7 release
* add reset\_controllers\_non\_main\_vip tests , add both testst in cloud\_disrutpions
* add a reset\_controller\_main\_vip disruptive test
* Compile Python3 on RHEL-7
* Remove python3-devel package from RHEL-7 bindeps
* Use rebased Python 3.8 IR patchset
* Create Docker files for Tobiko project
* Add Fedora 32 IR jobs (with Python 3.8)
* Disable tempfs mounting on /tmp of Fedoras
* Update Ubuntu Focal job IR patchset version
* Run IR CentOS 7 job with IR master branch
* Stop considering OpenStack upstream requirements good for InfraRed Tox environment
* Fix condition check if previous task was skipped
* Add support for Fedora 31 and Python 3.7
* Restore IR CentOS 7 support based on Python 3.6
* Move tobiko-devstack-faults-ubuntu-bionic job to periodic pipeline
* Add support for ubuntu 20.04 LTS and Python 3.8
* Allow jobs to pick arbitrary version of InfraRed
* Move TripleO jobs to periodic pipeline
* Set default git version
* Fix deploy role when no deploy-src-dir is given
* Move IR requirements file to IR plugin folder
* Remove support for Python2.7 on all upstream jobs
* Implement cached property tool
* Add pylint Tox environment
* Switch to pylint>=2.5.2
* Move CI tasks from roles to infrared\_plugin/roles
* Remove DevStack CentOS 7 jobs
* Test Tobiko against Python 3.8.3
* Test DevStack with CentOS 8
* Test Tobiko against Python 3.8.2
* Remove rendundant job tobiko-tox-py36-centos-8
* Add infrared\_plugin to ansible lints
* Switch to flake8>3.8.1
* Avoid using tobiko-deploy for TripleO CI jobs
* Avoid using tobiko-deploy for DevStack CI jobs
* Remove old IR plugin and old related CI tools
* Fix Jenkins vars inclusion
* Added --ignore-test-failures CLI flag
* Add RH subscription manager support to role testing Vagrantfile
* Refactor test execution scripts
* Add tox-infrared-centos-8 to gate jobs
* Fix pylint version requirements
* Continue running workflow steps after step failures
* Use upper-constraints file from requirements project
* Revert "Add tox-infrared-centos-8 to gate jobs"
* Add tox-infrared-centos-8 to gate jobs
* Remove python3-devel package from rhel7 bindeps
* Fix broken infrared toxenv on CentOS/RHEL-8
* Increase maximum number of SSH connection attemts to 100 to fix timeout issues
* Remove obsolete roles
* Allows to run tobiko-tox-infrared jobs from other repos than Tobiko
* Update IR plugin
* Switch to new IR plugin for TripleO jobs
* Clean-up zuul integration role
* Remove broken TripleO CI jobs
* Fix looking for ovs agent based on compute node name
* Fix faults test workflows
* Prevent installing 2.5.0 PyLint version
* Use the new ansible roles for DevStack CI jobs
* Switch to CirrOS image version 5.1
* Add way to know topology is based on containers
* Fix infrared plugin default test\_host execution
* Fix name of the Neutron L3 agent service in case of TripleO
* Remove voting from tobiko-devstack-functional-centos-7 job
* Checkout files only when not copied from src\_dir
* Use OS stable/train branch for testing with DevStack centos-7
* Increase wait\_for\_cloud\_init\_status timeout to 20 minutes
* Use test\_become flag in Tobiko ansible roles
* Set remote test directories owner user
* Move infrared plugin to infrared\_plugin/ folder
* Automatically select a test host from inventory file
* Create workflows for before and after updates/upgrades
* Test against stable/train with DevStack and CentOS 7
* Set nova keyfile only if value is given
* Change order conf files are imported
* Update tobiko-deploy role
* Add faults-neutron workflow
* Make the reset\_all\_controller\_nodes() method work with a composable control plane
* Switch to 2-node configuration for IR plugin testing
* Reduce test\_reboot\_computes\_recovery duration
* Update pre-run roles
* Add Ubuntu Bionic Infrared plugin job
* Introduce a get\_groups function openstack topology and let list\_openstack\_nodes accept group lists
* Implement test workflow steps
* Add wait\_for\_all\_instances\_status for test\_reboot\_computes\_recovery
* Add Vagrant tests for infrared plugin (CentOS 8)
* Separate roles in pre-run, run and post-run phases
* Update tobiko-deploy and tobiko-ensure-\* roles
* Update roles requiring python
* Remove tobiko-tox-infrared-ubuntu-bionic job
* Remove centos-7 unit tests jobs
* Use zuul tox job for running tox
* Verify infrared plugin actually collect output files
* Make reports with python-subunit>=1.4
* Add role to ensure bindep is installed on target host
* Add role to ensure tox is installed on target host
* Add role to ensure python3 is installed on target host
* Install git only on knwon Linux platforms
* Allow to specify python interpter used for testing IR plugin
* Test that DHCP lease is correctly served when DHCP agent is down
* add test\_hard\_reboot\_controllers\_recovery test
* Add role to ensure git is installed
* Let automate coloring in infrared environment
* Copy test result files to zull logs dir
* Separate run\_tox and make\_report tasks
* Import local infrared workspace if it exists
* Use default python for testing infrared plugin
* Help debugging tobiko-configure role with better output
* update to centos-8
* Rebase tobiko-tox-py\* jobs on top of openstack-tox-py\* ones
* Execute test cases with InfraRed plugin on CenOS and Ubuntu
* Add Neutron OVS agent faults tests
* Add Neutron L3 agent faults test cases
* Keep separed test results messages from errors
* Fix tox environemnt setup when missing binary packages
* Allow to get prefix of base python interpreter
* Reduce verbosity of make\_report script
* Remove trailing space
* Use regular tox as default command
* Spliting infrared plugin into roles
* Try connecting to undercloud-0 host to verify it exists
* Skip tests from RebootNodesTest on non TripleO based cloud
* Add support for networker nodes to assert\_ovn\_containers\_running
* Stop using system SSH config files by default
* Add missing requirement to report environment
* Get configured nova key file path relative to tobiko.conf file
* Fix has\_ipv6 property in network fixture
* speed up containers sequencial calls with cache
* add object container action support
* Add support for OSP13 to assert\_ovn\_containers\_running
* Download IR workspace from a URL before importing it
* Remove devstack-ovn jobs
* Import infrared workspace if available
* Resolve overcloud key file path relative to tobiko.conf file
* Remove fedora nodeset
* Switch to Fedora 30
* add container\_runtime\_name str var to containers.py it will contain podman/docker as deployed
* test\_cloud\_recovery.health\_checks cleanup vm\_create method implementation
* fix for : remove os-faults bug and commented ha checks
* Added OVN container verifications to test\_cloud\_recovery.py
* make use of csv files with container state checks
* Check containers after VM creation
* Fix ovn\_resource\_healthy function
* make reboot computes tests more robust and logging clearer
* start all nova instances if any, to not break containers before after test also make container state before after retryable
* Revert "Split command lines using shlex module"
* Switch from CentOS 7 image to version 8
* Add APIs to manage cloud-init on Nova servers
* Split command lines using shlex module
* Add default nameservers to IPv4 subnet
* Add Neutron dhcp agent faults test cases
* fix false : AssertionError: nova agents are unhealthy and : OvercloudProcessesException: not all overcloud processes are in running state, process nova-scheduler is not running
* Fix stack creation bug
* fix =<osp13 container /name->name
* add ability to fail tests, to pacemaker resources health check
* Revert "Fix shell command execution"
* faults add baseline overcloud health check
* unblock Downstream CI : STDERR: virtualenv.py: error: no such option: --seeder
* Add specific common tripleo container checks , and nova services, and fix podman client bug
* Normalize SSH keyfile paths before connecting
* Use default configured SSH key for cloud nodes
* Use socket.gethostname() to get local hostname
* Fix shell command execution
* Add nodes group anyway when node is unreachable
* Mark irrelevant files for tipleo jobs
* Update docker and podman functional tests
* Find an external network when no one is provided
* Remove unused integrations: os\_faults and ansible
* Write to log the error relater keystone credential failure
* Collect tobiko.conf file on CI jobs
* Allow to ignore ip command errors
* Remove faults integration documentation
* Remove Fedora based image and server stacks
* Fix Tox Infrared job
* Skip RebootHostTest because often failing
* fix stack not found bug
* Remove non voting tribleo functional test job from gating group
* tobiko ir plugin report latest patch name for debugging
* Collect tobiko.log file
* Revert "Allow to configure undercloud via ssh\_config file"
* Revert "Allow to configure undercloud via ssh\_config file"
* Allow to configure undercloud via ssh\_config file
* HA health checks add neutron agents health check
* add test all neutron agents are healthy
* unblock downstream by not erroring out during tests stages, rather report via the junit result so that if a test fails it will mark the job as yellow(test failed) and not red(automation failed)
* add tripleo containers health checks and use it in compute reboot test done refactoring, unit tests are pasing , system tests are passing
* Restore TripleO CI jobs using new Tobiko role
* Test rebooting VM with floating IP test cases
* Create reboot host operation
* Debug log file configuration step
* Remove voting from CentOS unit test jobs
* add compute reboot faults tests with added boot vm checks related bz : https://bugzilla.redhat.com/show\_bug.cgi?id=1797892
* Revert "Allow to configure undercloud via ssh\_config file"
* Create shell function to reboot an host
* Improve shell command execution verbosity
* podman client add podman access via varlink commands also fix the podman tests
* Allow to configure undercloud via ssh\_config file
* Use tobiko.conf directory as starting directory for relative paths
* Make sure Python 3 is installed before running DevStack
* Disable report files compression by default
* Allow to disable report files compression
* Fix bug executing a command after loosing SSH connectivity to host
* Override fixture context methods with setup/cleanup functions
* Add nova client functions to shutdown and activate Nova server
* Fix tools/ci/tox script when 'python' command is not available
* Disable memory\_tacker service
* Fixed devstack plugin
* Switch from peakmem\_tracker to memory\_tracker service
* Add wait\_for\_server\_status function for nova
* basic HA test : disruptive action and health checks
* Missing binary packages don't interrupt tools/ci/tox script
* Move realpath implementation tools/ci/activate
* Add Fixtures to set server group for nova instance
* Fix fetching of maximum length of VM's console output
* Fixes for podman client (client tunnel discovery, client creation and tests)
* Use "platform:rhel-8" in bindep to specify it is RHEL8
* Run unit tests with CentOS 8
* Debug Infrared role Python installation script
* Add API for defining cloud operations
* Fix tools script python warnings
* Use default unit test jobs as OpenStack Train and Ussuri
* Create Tox InfraRed upstream job
* Drop support for Python3.5
* Run unit tests with python3.6 distributed with CentOS 7
* Add tox environment to check missing binary dependencies
* Install missing dependencies on Ubuntu
* Add yum repos for installing missing packages if needed
* Install python3 packages using bindep in tox ci script
* Pass tobiko.conf changes using a dictionary
* Rename tobiko role pre/post folders
* Rename upstream CI playbooks
* Drop support for Python 2.7
* fix services polling and make it more robust
* Implement docker module unit tests
* Use tools/ci/tox script for running tests and making reports
* Edit keystone cloud\_name option
* Podman integration
* Gate project using jobs targeted for testing Tobiko (unit & functional)
* Disable non-master centos jobs
* Use bindep role to install Python3 packages
* Compile Python with missing deps and shared libs
* Use Python 3.7 for setting up DevStack on CentOS
* Relax Python2 verification in mypy linter
* Use master branch of python-subunit to generate reports
* Use /usr/local as default python prefix
* Ensure sudo can find python3 command
* Verify python and pip command works before installing them
* Run unit tests with Python 3.8
* Create Ansible role to install arbitrary Python version
* Force using python2.7 for building reports
* Skip test cases when nova scheduler hints are not respected
* Add ansible playbooks linters job
* Use bionic image as default nodeset for sigle-node devstack jobs
* Use only Python 2 for subnodes in CentOS7 DevStack jobs
* Ensure tobiko.log is writable
* Let python wrapper script choose wich default python version to use
* Use octaviaclient tagged release instead of git master branch
* By default save tobiko.log file to the same folder of tobiko.conf file
* Produce separate named report files
* Disable OVN job
* Prepare tobiko execution in tobiko role
* Fetch tobiko.log file after execution
* Update DevStack plugin
* Add simple Octavia traffic scenario
* Restore octavia to DevStack jobs
* Add train CentOS job
* Add optional user\_data option for nova servers
* Use master branch for DevStack CI deployment
* Create generic ansible Tobiko role for CI
* Temporarly disable octavia DevStack plugin
* Remove rendundant required projects from OVN Devstack job
* Create OVN based DevStack CI jobs
* Update Vagrantfile to use networking-ovn with DevStack
* add ability to get nodes processes as pandas tables(dataframes) for querying 2nd commit
* add ability to get list of nodes running pacemaker resources
* Allow to pick python version in CI tools
* Fix DevStack CI jobs
* Temporarly remove tripleo CI jobs
* Create upstream CI faults jobs
* Let have 4 Tripleo standalone jobs
* Revert "Revert "Use DevStack stable/train branch for upstream CI""
* Revert "Use DevStack stable/train branch for upstream CI"
* Allow to create SSH client using netaddr.IPAddress instance
* Update Glance client
* Update Nova client
* Update Neutron client
* Add method to format shell command results
* Create temporary files on the same directory of target file
* add ability to get list of nodes running systemctl services
* Create first tripleo-ci job
* Workaround os-fault limitation to only default (22) SSH port
* Redirect localhost port 22 to Vagrant VM
* unset vms quota for tobiko tests
* Fix os-faults config file generation
* Use DevStack stable branch in Vagrantfile
* Use DevStack stable/train branch for upstream CI
* Cleanup base octavia job
* Set up Octavia on all DevStack functional and scenario jobs
* Add DevStack CI job for CentOS with Octavia
* Remove four nodes job
* Pass mypy type verifications
* Add mypy CI job
* Remove DevStack CI disable jobs
* Fix syntax Error in functional test
* Remove tobiko-devstack-scenario-fedora-latest from check list
* Use tobiko gather\_details function in fixtures library
* Update ping wrapper
* Remove unreliable test cases
* Add support for IPv6 for inet utils ping command
* Allow to execute commands from inside a network namespace
* Add Octavia do DevStack standalone vagrant image
* Increase glance image polling intervall from 1 to 5 seconds
* Add test cases to list docker containers on cloud nodes
* Add docker client module
* When image is None, image ID has to be reported as None
* Update octavia client
* Fix handling of getaddrinfo format errors
* Fix handling of MultipleException
* Ignore tobiko\_result.\* files
* Test ports with L3HA and CentOS/Ubuntu nova servers
* Add support for remote unix socket forwarding
* Skip test case when there are not enogth L3 agents
* Create new tobiko.http package
* Fix test\_list\_ip\_addresses\_with\_host\_scope test case
* Implement SSH port forwarding on top of sshtunnel library
* Implement HTTP over SSH tunneling
* Use CentOS 7 in Vagrant file
* Fix support for multiple SSH key files
* Pass unit tests when cloud name is configured
* Add tobiko-devstack-scenario-centos-7-train upstream CI job
* Improve the use of tobiko framework in test\_routers
* Update Neutron port scenario test case
* Fix nova hipervisor API test case
* Add node selection by hostname
* List namespace IPs using the new ip command wrapper
* Remove test cases executing SSH client binary
* Handle timeout problems in execute\_process function
* Add port test case for pinging gateway IPs
* Workaround paramiko timeout problem
* Fix network stack gateway properties

0.2.0
-----

* Add stack properties to get network gateway IPs
* Use tobiko selection API for filtering L3 router agents
* Update topology API
* Remove \*.test\_ssh\_command test cases
* Relax low coverage trealdshold
* Remove \*.test\_ssh\_from\_cli test cases
* Allow to select IP address by scope
* List namespaces and namespace IPs on cloud nodes
* Add wrapper for IP command
* Add test to verify VM can ping all gateway route ports
* Add tests for routers
* Create test case for Neutron ports
* Install ip command on RH's distros
* Add bindep file
* Generate os-faults.yaml using new topology API
* Fix Openstack topology discovery for Python 2
* Create scenario test case for cloud nodes
* Allow to get host\_config and connect parameters before connecting to SSH server
* Add controller topology nodes group
* Add wrapper for ipconfig shell command
* Fix wrapper for 'hostname' shell command
* Add support for proxy\_client parameter to ssh.ssh\_client function
* Fix ping fixed delay at the end of command execution
* Update tripleo topology driver
* Implement TripleO topology driver
* Create OpenStack topology API to interact with cloud nodes
* Copy the build ssh key to authorized\_keys on all hosts for stack
* Add functions to look for port IP addresses
* Wraps 'hostname' command
* Fix class constructor
* Fix import order
* Remove files added accidentally to the repo
* Check pacemaker resources
* Fix os-fault CLI command executor
* Add report files to Git ignore files
* Configure upstream DevStack CI jobs with Octavia
* Add support for SSH proxy in os-faults integration
* Safely generate os-faults file to temporary files
* Disable colorized log files on DevStack CI jobs
* Fix clouad.yaml support debug message
* Add support for clouds.yaml file in DevStack plugin
* use subunit2junitxml for junit-xml report otherwise jenkisn can't read the results
* Handle multiple ping commands dialects
* collect junit xml results
* Debug local process brute termination
* Use OpenStack default config files and directories
* Workaround SSH command timeout problems
* Add ping timeout functional test case
* Generate subunit results XML file report
* Fixes: ansible shell non needed quotes :
* Write to log the begin and the end of every test case
* ir plugin conditional python3 / 2 :
* Skip functional test case that is producing undebuggable failures
* add report collection for downstream jobs
* Update get\_exit\_status for shell process classes
* Set path for tobiko logs in devstack tobiko jobs
* Execute single node upstream CI job checks
* Refactor OS-faults integration
* Enable Neutron L3 agent on sub-nodes on upstream CI
* Wait for server console output if empty
* Debug ping command output
* Fix remote process get\_exit\_status method
* Remove RTD Pip requirements file
* Fix ping error command handler when unknow host error is received
* Disable often failing test cases
* Update tox.ini style
* Add single node devstack upstream CI job
* Enable PEP8 extensions
* Enable ignored PEP8 verifications
* Fix centos 7 DevStack CI job
* Fix shell process execution:
* Fix docs building requirements
* Check stack status before fetching Nova server details
* Fix Nova quota instances for upstream CI
* Prevent unestable openstack-three-node-centos-7 job from voting
* Use the IPv6 documentation prefix as the default cidr
* Fix code style for passing PEP8 verifications
* Don't threat as an error when OS\_CLOUD env variable is not defined
* Reduce custom MTU value because of restrictions
* Make clouds file support configurable
* Update OpenStack clouds file support
* Add Fedora image and flavor fixtures
* Enable DevStack os-fault plugin
* Add SSH connectivity to overcloud nodes
* Change server console output format to JSON
* Add support for clouds config file
* Use fedora-29 instead of fedora-28
* Update server stack details dumping
* Add functions to get overcloud nodes IP addresses
* Add functions to list overcloud nodes
* Add functions to connect to undercloud APIs
* Update tripleo configuration
* Use tobiko.makedirs instead of os.makedirs to avoid concurrency problems
* Allow to gather detail content from a json object
* Increment SSH connection tries intevals
* Debug and fix execution loop in comunicate process
* Ignore encoding errors
* Add CentOS image and flavor fixtures
* Check hostname without domain name
* Add VM to VM L3HA connectivity test cases
* Re-enable functional test case for Ubuntu based VMs
* Fix test case for getting server console output from server stack
* Fix typo in NeutronClientManager class name
* Fixed incorrect default directory mode
* Take out overcloud stuff from undercloud module
* Fix duplicated details gathering
* Add functions to list or find nova server instances
* Create fixture to translate OS\_\* env variables to Keystone credentials
* Add functions to fetch OS\_\* env variables from stackrc and overcloudrc files
* Add Nova server console output as test failure detail
* Add functions to ssh connect to undercloud-0 as stack user
* Add API call to capture Nova servers console output
* Add captured log lines to test case details
* Patch HTTP proxy environ variable in unit tests
* Export no\_proxy option always when it's set in config file
* Add functional test case for undercloud SSH connection params
* Rename skip\_until to skip\_unless
* Fix default username and port for SSH client connection
* Create unittest for tripleo tobiko.conf section
* Create TripleO section in tobiko.conf
* Delay tobiko config initialization
* Fix logging line in tobiko.config
* Add possibility to prevent Tobiko from creating test image
* Update VM to VM conectivity test case
* Skip different host test if there are less then two hypervisors
* Test VM to VM connectivity
* Remove old resource searching modules
* Update Glance image search
* Update Keystone resource search
* Update Neutron resource search
* Update ipervisors selection by attribute
* Fix concurrent SSH key file creation
* Update neutron agent listing
* Add test floating IP test case with HA router
* Skip Ubuntu server test case because of flaky failures
* Add toools for listing hypervisors and skiping when missing some
* Add function to select objects by attribute values
* Update and test nova\_client function
* Add API to list neutron agents and skipp tests if missing some
* Look for tobiko.conf into current direcory and its parents
* Fix build autogenerated config files doc on RTD
* Switch from py36 to py37 as default python3 interpreter version
* Add autogenerated tobiko.conf example file
* Remove publishing to docs.openstack.org
* Add possibility to prevent Tobiko from creating test resources
* Add requirements file for RTD builds
* Automatically create SSH key file if it doesn't exists
* Update documentation after some required resources creation has been automated
* Remove unused default nova flavor
* Add tobiko.conf to .gitignore file
* Add glance client to requirements file
* Adds octavia client integration
* Add find\_service\_endpoint keystone function
* Fix typo in keystone client integration
* Separate keystone monkey patching from base openstack test case
* Create base mixin class for patching in unit tests from test cases and fixtures
* Allow to override fixture initialization in FixtureManager class
* Autogenerate config options and sample config file
* Add Ubuntu image and flavor fixtures
* Allow skipping in case service is not available
* Add Keystone client API
* Fix default tobiko configuration file location
* Move default server fixture to new cirros module
* Add support for XZ image decompression
* Fix SSH connectivity issues
* Increase RAM to 128Mb for CirrOS based VMs
* Check code complexity
* Reduce code complexity of tobiko/tests/unit/cmd/test\_fixture.py
* Reduce shell process 'communicate' method code complexity
* Reduce ping code complexity
* Fix local command execution
* Implement glance image files decompression (zip, gz, bz2)
* Fix check\_image\_status function
* Handle Glance image concurrent creation
* Fix find\_resources functions
* Remove configuration of flavor in InfraRed plugin
* Fix flavors concurrent creation
* List stack resources in HeatStackFixture
* Update documentation after adding fixture to create flavors
* Remove configuration of flavor in DevStack plugin
* Create a loop for defining image configuration option
* Add fixture to create flavor for CirrOS images
* Fix CirrOS image fixture configuration (URL, container\_format, disk\_format)
* Fix shell package
* Restructure shell package
* Fix DevStack jobs: mark files as irrelevant
* Let KeystoneCredentials.to\_dict() method to return a dictionary
* Add tool to print out yaml file to js format
* Bug fix for : https://trello.com/c/Jjij9ktA/131-fix-tox-not-found-in-downstream-job
* Use CirrosGlanceImageFixture to fetch CirrOS image on Infrared
* Add command to print out keystone credentials used by Tobiko
* Increase default ping timeout from 60 to 90 seconds
* Update documentation after cirros image creation has been automated
* Use CirrosGlanceImageFixture to fetch CirrOS image on DevStack
* Implement Glance image management (setup and cleanup)
* Create wrapper to sys.exc\_info
* fix for typo when: test.refsec for https://trello.com/c/NOgGkEXH/123-add-infrared-plugin-option-gerritchangeid-to-select-specific-patch-for-ir-plugin
* Recursively list required fixtures
* Add tobiko-fixture CLI wrapper to CI tools
* Update CI tools with an openstack wrapper
* Use stack fixture name as seed for random CIDR generation
* allow specifying custom tobiko gerrit refsec for checking out and testing a specific patch
* changes missed for: https://review.opendev.org/#/c/665966/13
* - allow rerunning of infrared tobiko configure tasks - also set external net name according to osp version - fix the string bug when using multiple words with --tests : http://pastebin.test.redhat.com/773150 Change-Id: I1d217f179be13498bb5f21b777d39636292da835
* Generate random subnet CIDRs
* Skip test cases for broken CIDR subnet assignation
* Restore execution of FloatingIpWithMtuWritableTest
* Use CirrosImageFixture in existing stacks
* Add package for OpenStack Glance client
* Fix tests to check network network stack subnet gateway ips
* Add support for dynamic parameters allocation in Heat stacks
* Update Neutron Client
* Update OpenStack clients to improve 'lazyness'
* Improve keystone client 'lazyness'
* Add check valid type function
* Add reset fixture function
* Use NetworkWithNetMtuWriteStackFixture for testing net-mtu-write extension
* Improve neutron client integration
* Add n-api-meta and q-agt services to DevStack subnodes
* Rename fixture: NetworkWithNetMtuWriteStackFixture -> NetworkWithNetMtuWriteStackFixture
* Use FloatingIpServerStackFixture in test\_floating\_ip
* Use connect SSH client method to wait for networking connectivity
* Update fixtures for creating networks
* Create functional test case for NetworkStackFixture
* Add basic ssh connection test cases
* Remove test case properties
* Rename "floating\_ip\_stack" attribute name as "stack"
* Update test\_floating\_ip docstrings
* Get stack otputs direclty from stack attribures
* Add support for net-mtu-write to NetworkStackFixture
* Remove .outputs reference when not needed
* Optimize getting stack outputs
* Let get\_fixture\_name skip calling \_\_getattr\_\_ method in shared fixtures
* Update heat stack template and outputs
* Try to fix failing RTD web hook
* Move security group stack fixture to shared package
* Verify shared stack hostname
* Use shared floating ip server stack in test\_floating\_ip
* Update shared fixture classes

0.1.1
-----

* Configure documentation upstream CI jobs
* Update tobiko documentation page URL
* Fix test\_ssh after Include directive is being ignored
* Implement async shell result handling
* Refine tobiko faults
* Update irrilevant files for Devstack CI jobs
* Fix keystone credentials

0.1.0
-----

* Fix : /bin/sh: line 1: wget: command not found
* Use NovaKeyPairFixture in neutron scenario test cases
* Create reusable Heat staks
* Add info about Heat in Devstack
* Disable SSH agent formarding by default
* Update SSH client integration
* Test SSH connectivity via floating IP
* Update SSH client integration
* Compare port security groups as sets
* Cleanup zuul configuration
* Add compute host service to single-node functional job
* Run all scenario test cases
* Automatically select python version on scenario and fucntional tests
* Update CI job irrelevant files
* Update docs requirements and fix link
* Pass to default python for static analisys tests
* Pass statical analisys wiht Python2
* Rename package: tobiko.shell.paramiko -> tobiko.shell.ssh
* Rename package: tobiko.tests -> tobiko.tests.unit
* Override fixture manager in every unit test
* Add tox environment to generate HTML test case reports
* Fix SSH connection procedure when server instance is booting
* Add fixture\_property decorator
* Update Paramiko integration
* Reduce fixture managing verbosity
* Add paramiko SSH client integration
* Add infrared plugin to tobiko
* Fix tobiko-fixture subcommand
* Update requirements after ansible 2.8 release
* Update DevStack plugin after Keystone auth params improvement
* Improve KeyStone credentials parameter handling
* Fix ping when no stdout is given
* Update project goals in README.rst file
* Sort Zuul project templates and jobs by name
* Document how to configure Tobiko and run scenario test cases
* Fix requirements and use ReadTheDocs HTML documentation theme
* Create Nova key pair with random name
* Addition of (nova ssh) key\_pair\_fixture with cmdline,heat template, and a stacks fixture class to be used in test\_floating\_ip scenarios
* Clarify README.rst, remove duplication in docs/index.rst
* Add missing copyrigths
* Refine and add docstrings to fixture module
* Refactor exceptions message formatting on top of format method
* Update README file
* Add quick start guide to RST documentation
* Document and refine scenario tests
* Create docs job and environment
* Restore voting flag to CentOS 7 CI job
* Add copypastable quick start section
* Use CI pipelines from upstream project templates
* Add PyPi pubblication CI jobs
* Add devstack functional job
* Move shell test cases to functional package
* Add cover CI job and tox env
* Let run test cases of the same class by the same parallel executor
* Add Jinja2 to requirements file
* Skip FlatingIpWithMtuWritableTest when net-mtu-writable is not available
* Remove neutron-requirements.txt file
* Handle "No route to host" ping error message
* Refactor tox.ini to match OpenStack Project Testing Interface
* Call again setup\_fixture and cleanup\_fixture after they fails
* Skip test cases by setUp method instead of setUpClass method
* Update README.rst after OpenDev Migration Patch
* OpenDev Migration Patch
* Re-assign voting flag to Fedora 28 job
* Revert "Enable voting to CentOS 7 jobs (Rocky and trunk)"
* Refactor fixtures test cases
* Refactor test\_floating\_ip using the new required\_fixture\_setup function
* Enable voting to CentOS 7 jobs (Rocky and trunk)
* Modify quick-start doc
* Refactor required fixtures listing
* Remove "constants" module
* Remove stack manager class
* Remove duplicate method
* Add required fixtures to tobiko-fixture list command
* Test net-mtu-writable networking API extension
* Allow skipping test cases when missing networking extensions
* Allow to decorate for skipping fixtures or test case classes
* Make setup\_stack aware of Heat concurrency issue
* Check it gets something from stderr before handling ping errors
* Remove voting from Fedora 28 and CentOS 7 jobs
* Temporarly remove vote to CentOS stable branches
* Allow pylint to execute paralled processes to speedup execution
* Replace tobiko.common.utils.network with tobiko.shell.ping
* Re-enable voting to Fedora-28 job and add stable branches CentOS jobs
* Implement ping command wrapper
* Create base tool to execute shell commands
* Move tobiko.common.managers.fixture to tobiko.common package
* Import base exceptions from main tobiko module
* Update requrements files
* Substitude class attribute 'parameters' dict to an easier to read individual class attributes
* Update Ubuntu version in Vagrantfile
* Disable dns-integration in Neutron in Fedora job
* Import base exception from tobiko package
* Add Tobiko credentials to devstack plugin
* Add reno for release notes management
* Test sending oversized ICMP packages over floating IP
* Remove old test cases based on stack manager classs
* Remove commands test cases
* Rewrite floating IP test case
* Create CentOS Neutron job
* Rename tobiko.openstack.nova.client module
* Rename tobiko.openstack.neutron.client module
* Rename tobiko.openstack.keystone modules
* Rename tobiko.openstack.heat modules
* Adding an installation guide for Tobiko
* Disable voting for Neutron Fedora job
* Fix fleaky failures on Python 2.7
* Remove ClientManager class
* Create Heat stack fixture
* Create Heat template loader
* Rename tobiko.conf options and split openstack config module
* Addition of verbose / quiet options to tobiko cmd
* Add tobiko-neutron job based on Fedora 28 images
* Use only pep8, pylint, py36 and py27 as default tox envs
* get\_fixture with fixture instance return instance itself
* Create OpenStack clients using new tobiko.openstack package
* Disables Swift on tobiko-devstack job
* Replace openstack.org git:// URLs with https://
* Add fixture to create nova client
* Add install command to IR plugin
* Add fixture to create neutron client
* Check actual client/session instance classes
* Create fixture for creating heat client
* Implement base classes for Openstack clients
* Fix get\_keystone\_session
* Remove tempest.conf integration
* Make sure default credentials exists in openstack unit tests
* Add tobiko-fault command
* Add licence type to cryptography extra requirement
* Initialize Keystone session using the new keystone package
* Create Keystone session manager class
* Create Keystone session fixture class
* Get default credentials using new keystone package
* Patch default credentials when executing command unit tests
* Fix typing error
* Create fixtures for default Keystone credentials
* Make Heat and Neutron clients creation lazy (just-in-time)
* Rename "identity" section as "keystone" in tobiko.conf
* Create model class to store Keystone credentials
* [Devstack] Use devstack's install\_python3 function
* Get parsed test results in tobiko-devstack job
* Reduce logging verbosity in fixture manager
* Patch "http" section in HTTP proxy configuration test case
* Write to log undefined variables and options
* Use openstack-three-node-bionic nodeset in tobiko devstack job
* Move HTTP proxy support behind a fixture. Make it more reliable
* Move tobiko test config to new tobiko.openstack package
* Fix return type for cleanUp override method
* Implement get method on SharedFixture class to shorcut get\_fixture method
* Refactor fixture manager test cases
* Make shared fixture class smarter to use
* Enable services according to DevStack multinode configuration
* Restrict n-cpu service to subnodes
* Move HEAT from subnodes to controller
* Add compute2 to subnodes and peers groups
* Implement "help" subcommand and handle setup/cleanup errors
* Implement "setup" and "cleanup" fixture sub-commands
* Implement "tobiko fixture list" subcommand
* Parse additional stestr paramters
* Start implementing tobiko-fixture command
* Implement shared fixture base class
* Use mock library to verify setUp and cleanUp are called
* Rebase fixture management on top fo fixtures library
* Capture Python warnings
* Discover test case method dependencies using load\_object function
* Add passenv vars to tox neutron virutalenv to allow connecting to OS
* Remove Nova from controller node
* Use multinode configuration for DevStack CI jobs
* Add Nova client
* Disable "unsafe" os-fault operation (for the second time)
* Remove dependency from crayons library
* Revert "Disable "unsafe" os-fault operation."
* Add Tobiko run command
* Implement load\_module function
* Limit max default concurrency for tox jobs
* InfraRed Integration Skeleton
* Resolve stack outputs when required
* Remove load\_modules method
* Add object loader
* Disable "unsafe" os-fault operation
* Add support for faults
* Allow disabling tempest integration
* Create method to load test case modules
* Create method to list test case IDs unsing stestr
* Create abstract fixture manager
* Improve stack error reporting
* Add licence type into requirements files
* Update project requirements
* Vagrantfile: configure to pass neutron test cases
* Vagrant: syncronize resolf.conf and Tobiko files
* Pass options from local.conf ot tobiko.conf
* Expand floating allocation pool
* Enable heat services
* Disable devstack job for gate trigger
* Execute existing neutron tests on upstream CI
* Allow to run playbooks in delete mode
* Add method to Ansible manager to run playbooks
* Prepare devstack environment for executing tox -e neutron command
* Create Vagrantfile for manual testing via DevStack
* Ignore log files
* Fix environment configuration options retrieval
* Execute unittest with py37 tox env in upstream CI
* Fix unit tests when checking for os.walk calls
* Add password config option
* Read OS credentials from tobiko.conf
* Add Ansible manager
* Configure DevStack job
* Modify some simple error
* Refactor test\_mtu test case after base scenario test case changed
* Recreate stacks before executing scenario tests
* Refactor scenario test case to create template in setUpClass method
* Rebase list command unit test on top of base command unit test
* Add wait flag to delete command
* Add wait flag to create command
* Move CREATE\_COMPLETE constant to stack.py
* Write log messages to STDERR in tobiko commands
* Add devstack Zuul job
* Add  openstack-discuss
* Document proposed Tobiko workflow in a short quick start guide
* Fix doble writes of logging messges to STDERR when using stderr
* Use tobiko/tests as test\_path discover directory for stestr
* Split tox environments requirements files
* Improve ping command tracing
* Use Python3 for running neutron tests
* Improve ping utils
* Create test case stack (self.stack) from setUp base class method
* create\_stack and wait\_for\_stack\_status return get\_stack result
* Check for stack status before getting outputs
* Check ip\_address in ping\_ip\_address function
* Write log messages to STDERR by default and silence tempest DEBUG messages
* Fix ping shell when not SSH proxy is given
* Run zuul jobs for pylint, py35 and py27 tox environments
* Split tox environments (pep8, pylint, py27, py35 and neutron)
* Add Ansible playbooks directory and first playbook
* Review pylint violation warning adn fix setup\_tobiko\_config function
* Remove MissingTemplateException
* Add pylint static analysis test
* Pass pylint test with networking scenario tests
* Pass pylint test with unit tests
* Remove unused process utils
* Fix stack manager exception handling and pass pylint
* Refactor base exception
* Refactor config management for passing pylint
* Use logger lazy formatting
* Make sure absolute\_import is active in all modules
* Remove copyrigth notices from empty \_\_init\_\_.py files
* Get code coverage when running test cases
* Remote unused module "plugin"
* Remote duplicate stack module
* Remove duplicate module net\_utils
* Correct tobiko-list command args patching in test case
* Use sys.stdout.write to write out command output
* Fix comment in test\_delete
* Delete stack by name and assume no stacks means all stacks
* Allow calling tobiko-create without stack
* Fix create command and create test case for it
* Fix base command and create test case
* Fix or skip test cases after framework refactory
* Udate client allocation after client manager refactory
* Allow to ping from a remote proxy by configuring a shell command
* Take default config parameters from tobiko.conf and tempest.conf
* Get credentials from environ and lazly allocate clients
* Set base test class default attributes at class level
* Fix dummy ping assert command bug when should succeed is False
* Get config options from environment first, then tobiko.conf, then tempest.conf
* Split framework dependencies from test dependencies
* Add list CLI util
* Add MTU tests
* Add security groups tests
* Move to template per test class
* [Clients] Add support for env variables
* Add a cleanup utility
* Add a utility for setting up resources
* Add network manager
* Add additional instance to the default template
* Allow test classes not using the default stack
* Use class name as identifier for background ping
* Clean tests and move code to framework
* Create background ping helpers
* Add continuous ping tests
* Share stack across tests
* Update clients code to support v3 auth
* Use image from tempest configuration
* Add tobiko tempest to gate queue
* Add CI jobs
* Create tox.ini file
* Add files required for making this project a tempest plugin
* Add common module for handling clients
* Add common stack methods
* Add heat template for creating the stack
* Add two tests for testing instance connectivity
* Add initial structure
* Add minimal jobs file
* Added .gitreview
