v2.4.0-rc1

Quick Start

kubectl create namespace argo
kubectl apply -n argo -f https://raw.githubusercontent.com/argoproj/argo/v2.4.0-rc1/manifests/install.yaml

Changelog since v2.3

New Features

• WorkflowTemplate CRD (#1312) (@dtaniwaki)
• Centralized Longterm workflow persistence storage (#1344) (@sarabala1979)
• Support PodSecurityContext (#1463) (@dtaniwaki)
• Conditionally annotate outputs of script template only when consumed #1359 (#1462) (@sarabala1979)
• Support for WorkflowSpec.ArtifactRepositoryRef (#1350) (@Ark-kun)
• Ability to configure hostPath mount for /var/run/docker.sock (#1419) (@sarabala1979)
• Support hostAliases in WorkflowSpec #1265 (#1365) (@sarabala1979)
• Template level service account (#1354) (@sarabala1979)
• Provide failFast flag, allow a DAG to run all branches of the DAG (either success or failure) (#1443) (@xianlubird)
• Add paging function for list command (#1420) (@xianlubird)
• Allow overriding workflow labels in 'argo submit' (#1475) (@mark9white)
• Support git shallow clones and additional ref fetches (#1521) (@marxarelli)
• Add --dry-run option to argo submit (#1506) (@AnesBenmerzoug)

Refactoring & Improvements:

• Allow output parameters with .value, not only .valueFrom (#1336) (@Ark-kun)
• Exposed workflow priority as a variable (#1476) (@mark9white)
• Expose all input parameters to template as JSON (#1488) (@mark9white)
• Argo CLI should show warning if there is no workflow definition in file #1486 (@sarabala1979)
• argo wait and argo submit --wait should exit 1 if workflow fails (#1467) (@sarabala1979)
• Improve bash completion (#1437) (@edwinpjacques)
• Add --no-color flag to logs (#1479) (@dtaniwaki)
• mention sidecar in failure message for sidecar containers (#1430) (@tralexa)
• changing temp directory for output artifacts from root to tmp (#1458) (@alexcapras)
• Format sources and order imports with the help of goimports (#1504) (@muesli)
• Documentation (@ofaz, @bvwells, @pbrit, @shimmerjs, @ianCambrio, @jqueguiner, @ntwrkguru, @thundergolfer, @delwaterman, @Ziyang2go, @Aisuko, @mark9white, @mostaphaRoudsari, @commodus-sebastien, @thundergolfer, @xianlubird)

Bug Fixes

• Fix: Support the List within List type in withParam #1471 (#1473) (@sarabala1979)
• Fix #1366 unpredictable global artifact behavior (#1461) (@schrodit)
• Fix a compiler error (#1500) (@ian-howell)
• Fixed: failed to save outputs: verify serviceaccount default:default has necessary privileges (#1362) (@sarabala1979)
• Fixed: withParam parsing of JSON/YAML lists #1389 (#1397) (@ian-howell)
• Fixed: persistentvolumeclaims already exists #1130 (#1363) (@sarabala1979)
• PNS executor intermitently failed to capture entire log of script templates (#1406) (@jessesuen)
• Fix argo logs empty content when workflow run in virtual kubelet env (#1201) (@xianlubird)
• Terminate all containers within pod after main container completes (#1423) (@SeriousSem)

v2.3.0

Quick Start

kubectl create namespace argo
kubectl apply -n argo -f https://raw.githubusercontent.com/argoproj/argo/v2.3.0/manifests/install.yaml

Changelog since v2.2

Notes about upgrading from v2.2

• Artifact repository secrets are passed to the wait sidecar using volumeMounts instead of the
  previous behavior of performing K8s API calls performed by the executor. This is much more secure
  since it removes privileges of the workflow pod to no longer require secret access. However, as a
  consequence, workflow pods which reference a secret that does not exist, will now indefinitely
  stay in a Pending state, as opposed to the previous behavior of failing during runtime.

Deprecation Notice

The workflow-controller-configmap introduces a new config field, executor, which is a container
spec and provides controls over the executor sidecar container (i.e. init/wait). The fields
executorImage, executorResources, and executorImagePullPolicy are deprecated and will be
removed in a future release.

New Features:

• Support for PNS (Process Namespace Sharing) executor (#1214)
• Support for K8s API based Executor (#1010) (@dtaniwaki)
• Adds limited support for Kubelet/K8s API artifact collection by mirroring volume mounts to wait sidecar
• Support HDFS Artifact (#1159) (@dtaniwaki)
• System level workflow parallelism limits & priorities (#1065)
• Support larger workflows through node status compression (#1264)
• Support nested steps workflow parallelism (#1046) (@WeiTang114)
• Add feature to continue workflow on failed/error steps/tasks (#1205) (@schrodit)
• Parameter and Argument names should support snake case (#1048) (@bbc88ks)
• Add support for ppc64le and s390x (#1102) (@chenzhiwei)
• Install mime-support in argoexec to set proper mime types for S3 artifacts
• Allow owner reference to be set in submit util (#1120) (@nareshku)
• add support for hostNetwork & dnsPolicy config (#1161) (@Dreamheart)
• Add schedulerName to workflow and template spec (#1184) (@houz42)
• Executor can access the k8s apiserver with a out-of-cluster config file (@houz42)
• Proxy Priority and PriorityClassName to pods (#1179) (@dtaniwaki)
• Add the mergeStrategy option to resource patching (#1269) (@ian-howell)
• Add workflow labels and annotations global vars (#1280) (@discordianfish)
• Support for optional input/output artifacts (#1277)
• Add dns config support (#1301) (@xianlubird)
• Added support for artifact path references (#1300) (@Ark-kun)
• Add support for init containers (#1183) (@dtaniwaki)
• Secrets should be passed to pods using volumes instead of API calls (#1302)
• Azure AKS authentication issues #1079 (@gerardaus)
• Support parameter substitution in the volumes attribute (#1238)

Refactoring & Improvements:

• Update dependencies to K8s v1.12 and client-go 9.0
• Add namespace explicitly to pod metadata (#1059) (@dvavili)
• Raise not implemented error when artifact saving is unsupported (#1062) (@dtaniwaki)
• Retry logic to s3 load and save function (#1082) (@kshamajain99)
• Remove docker_lib mount volume which is not needed anymore (#1115) (@ywskycn)
• Documentation improvements and fixes (@protochron, @jmcarp, @locona, @kivio, @fischerjulian, @annawinkler, @jdfalko, @groodt, @migggy, @nstott, @adrienjt)
• Validate ArchiveLocation artifacts (#1167) (@dtaniwaki)
• Git cloning via SSH was not verifying host public key (#1261)
• Speed up podReconciliation using parallel goroutine (#1286) (@xianlubird)

Bug Fixes

• Initialize child node before marking phase. Fixes panic on invalid When (#1075) (@jmcarp)
• Submodules are dirty after checkout -- need to update (#1052) (@andreimc)
• Fix output artifact and parameter conflict (#1125) (@Ark-kun)
• Remove container wait timeout from 'argo logs --follow' (#1142)
• Fix panic in ttl controller (#1143)
• Kill daemoned step if workflow consist of single daemoned step (#1144)
• Fix global artifact overwriting in nested workflow (#1086) (@WeiTang114)
• Fix issue where steps with exhausted retires would not complete (#1148)
• Fix metadata for DAG with loops (#1149)
• Replace exponential retry with poll (#1166) (@kzadorozhny)
• Dockerfile: argoexec base image correction (#1213) (@elikatsis)
• Set executor image pull policy for resource template (#1174) (@dtaniwaki)
• fix dag retries (#1221) (@houz42)
• Remove extra quotes around output parameter value (#1232) (@elikatsis)
• Include stderr when retrieving docker logs (#1225) (@shahin)
• Fix the Prometheus address references (#1237) (@spacez320)
• Kubernetes Resource action: patch is not supported (#1245)
• Fake outputs don't notify and task completes successfully (#1247)
• Reduce redundancy pod label action (#1271) (@xianlubird)
• Fix bug with DockerExecutor's CopyFile (#1275)
• Fix for Resource creation where template has same parameter templating (#1283)
• Fixes an issue where daemon steps were not getting terminated properly
• argo submit --wait and argo wait quits while workflow is running (#1347)
• Fix input artifacts with multiple ssh keys (#1338) (@almariah)
• Add when test for character that included / (@hideto0710)
• Fix parameter substitution bug (#1345) (@elikatsis)
• Fix missing template local volumes, Handle volumes only used in init containers (#1342)
• Export the methods of KubernetesClientInterface (#1294)

v2.3.0-rc3

Changes since 2.3.0-rc2

• argo submit --wait and argo wait quits while workflow is running (#1347)
• Fix validate the secret credentials name and key (#1358)
• Fix input artifacts with multiple ssh keys (#1338) (@almariah)
• Add when test for character that included / (@hideto0710)
• Fix parameter substitution bug (#1345) (@elikatsis)
• Fix missing template local volumes, Handle volumes only used in init containers (#1342)

v2.3.0-rc2

Changes since 2.3.0-rc1

• Support parameter substitution in the volumes attribute (#1238)

• Fix regression where argoexec wait would not return when podname was too long
• wait will conditionally become privileged if main/sidecar privileged (issue #1323)
• argo list was not displaying non-zero priorities correctly
• Pod creation with secret volumemount (#1318)
• Export the methods of KubernetesClientInterface (#1294)

v2.3.0-rc1

2.3.0-rc1 (2019-04-10)

Changelog since v2.2

Features:

• Support for PNS (Process Namespace Sharing) executor (#1214)
• Support for K8s API based Executor (#1010) (@dtaniwaki)
• Adds limited support for Kubelet/K8s API artifact collection by mirroring volume mounts to wait sidecar
• Support HDFS Artifact (#1159) (@dtaniwaki)
• System level workflow parallelism limits & priorities (#1065)
• Support larger workflows through node status compression (#1264)
• Support nested steps workflow parallelism (#1046) (@WeiTang114)
• Add feature to continue workflow on failed/error steps/tasks (#1205) (@schrodit)
• Parameter and Argument names should support snake case (#1048) (@bbc88ks)
• Add support for ppc64le and s390x (#1102) (@chenzhiwei)
• Install mime-support in argoexec to set proper mime types for S3 artifacts
• Allow owner reference to be set in submit util (#1120) (@nareshku)
• add support for hostNetwork & dnsPolicy config (#1161) (@Dreamheart)
• Add schedulerName to workflow and template spec (#1184) (@houz42)
• Executor can access the k8s apiserver with a out-of-cluster config file (@houz42)
• Proxy Priority and PriorityClassName to pods (#1179) (@dtaniwaki)
• Add the mergeStrategy option to resource patching (#1269) (@ian-howell)
• Add workflow labels and annotations global vars (#1280) (@discordianfish)
• Support for optional input/output artifacts (#1277)
• Add dns config support (#1301) (@xianlubird)
• Added support for artifact path references (#1300) (@Ark-kun)
• Add support for init containers (#1183) (@dtaniwaki)
• Secrets should be passed to pods using volumes instead of API calls (#1302)
• Azure AKS authentication issues #1079 (@gerardaus)

Refactoring & Improvements

• Update dependencies to K8s v1.12 and client-go 9.0
• Add namespace explicitly to pod metadata (#1059) (@dvavili)
• Raise not implemented error when artifact saving is unsupported (#1062) (@dtaniwaki)
• Retry logic to s3 load and save function (#1082) (@kshamajain99)
• Remove docker_lib mount volume which is not needed anymore (#1115) (@ywskycn)
• Documentation improvements and fixes (@protochron, @jmcarp, @locona, @kivio, @fischerjulian, @annawinkler, @jdfalko, @groodt, @migggy, @nstott, @adrienjt)
• Validate ArchiveLocation artifacts (#1167) (@dtaniwaki)
• Git cloning via SSH was not verifying host public key (#1261)
• Speed up podReconciliation using parallel goroutine (#1286) (@xianlubird)

Bug Fixes

• Initialize child node before marking phase. Fixes panic on invalid When (#1075) (@jmcarp)
• Submodules are dirty after checkout -- need to update (#1052) (@andreimc)
• Fix output artifact and parameter conflict (#1125) (@Ark-kun)
• Remove container wait timeout from 'argo logs --follow' (#1142)
• Fix panic in ttl controller (#1143)
• Kill daemoned step if workflow consist of single daemoned step (#1144)
• Fix global artifact overwriting in nested workflow (#1086) (@WeiTang114)
• Fix issue where steps with exhausted retires would not complete (#1148)
• Fix metadata for DAG with loops (#1149)
• Replace exponential retry with poll (#1166) (@kzadorozhny)
• Dockerfile: argoexec base image correction (#1213) (@elikatsis)
• Set executor image pull policy for resource template (#1174) (@dtaniwaki)
• fix dag retries (#1221) (@houz42)
• Remove extra quotes around output parameter value (#1232) (@elikatsis)
• Include stderr when retrieving docker logs (#1225) (@shahin)
• Fix the Prometheus address references (#1237) (@spacez320)
• Kubernetes Resource action: patch is not supported (#1245)
• Fake outputs don't notify and task completes successfully (#1247)
• Reduce redundancy pod label action (#1271) (@xianlubird)
• Fix bug with DockerExecutor's CopyFile (#1275)
• Fix for Resource creation where template has same parameter templating (#1283)
• Fixes an issue where daemon steps were not getting terminated properly

Deprecation Notice

The workflow-controller-configmap introduces a new config field, executor, which is a container
spec and provides controls over the executor sidecar container (i.e. init/wait). The fields
executorImage, executorResources, and executorImagePullPolicy are deprecated and will be
removed in a future release.

v2.2.1

2.2.1 (2018-10-18)

Changelog since v2.2.0

• UI retrieve logs from artifacts location if logs archiving is enabled (issue #1018)
• Add imagePullPolicy config for executors (@dtaniwaki)
• Detect and indicate when container was OOMKilled
• support force namespace isolation in UI

• Workflow executor panic: workflows.argoproj.io/template not found (issue #1033)
• gc-ttl dose not work (issue #1004)
• Resubmission of a terminated workflow creates a new workflow that is already terminated (issue #1011)
• ZIP containing single file cannot be used as an artifact due to errors in init container (issue #984) (@mthx)
• Regression when S3 secret has trailing newline (issue #981)

• Documentation fixes (@gsf, @davidB, @dtaniwaki)

v2.2.0

2.2.0 (2018-08-30)

Notes about upgrading from v2.1

• The argo install and argo uninstall commands have been removed from the CLI. Instead, plain
  kubernetes manifests are provided to be installed using kubectl apply, or downstreamed into other
  tools (e.g. helm chart, ksonnet prototype, kustomize, etc...).

• In 2.1, argo would install into the kube-system namespace by default. The new install instructions
  have been updated to install into a different namespace, argo. In order to move to the recommended
  installation location, you should delete the v2.1 resources from kube-system before applying the
  new manifests to the argo namespace.

  The following commands migrates the workflow-controller-configmap from the kube-system to the
  argo namespace, and deletes all argo resources from the kube-system namespace. Note that this
  will delete the argo-ui service, resulting in the LoadBalancer being deleted (if created).

  kubectl get cm workflow-controller-configmap -o yaml -n kube-system --export | kubectl apply -n argo -f -
  kubectl delete -n kube-system cm workflow-controller-configmap
  kubectl delete -n kube-system deploy workflow-controller argo-ui
  kubectl delete -n kube-system sa argo argo-ui
  kubectl delete -n kube-system svc argo-ui
  

• In 2.1, the argoexec sidecar image was configured in the workflow-controller-configmap. This is
  now configured using a new --executor-image flag in the workflow-controller deployment. This is
  the preferred way to configure the executor image, since upgrades can now be performed without
  changing the workflow-controller configmap. The executorImage setting in the config is deprecated
  and may be removed/ignored in a future release.

Changelog since v2.1

• Support withItems/withParam and parameter aggregation with DAG templates (issue #801)
• Add ability to aggregate and reference output parameters expanded by loops (issue #861)
• Support for sophisticated expressions in when conditionals (issue #860)
• Introduce Pending node state to highlight failures when starting workflow pods (issue #525)
• Support additional container runtimes through kubelet executor (issue #902) (@JulienBalestra)
• Introduce archive strategies with ability to disable tar.gz archiving (issue #784)
• Introduce keyFormat workflow config to enable flexibility in archive location path (issue #953)
• Introduce argo watch command to watch live workflows from terminal (issue #969)
• Add ability to archive container logs to the artifact repository (issue #454)
• Support for workflow level timeouts (issue #848)
• Introduce argo terminate to terminate a workflow without deleting it (issue #527)
• Introduce withSequence to iterate a range of numbers in a loop (issue #945)
• Github login using go-git, with support for ssh keys (issue #793) (@andreimc)
• Add TTLSecondsAfterFinished field and controller to garbage collect completed workflows (issue #911)
• Add argo delete --older flag to delete completed workflows older than a duration
• Support referencing of global workflow artifacts (issue #900)
• Support submission of workflows from json files (issue #926)
• Support submission of workflows from stdin (issue #926)
• Prometheus metrics and telemetry (issue #896) (@bbc88ks)
• Detect and fail upon unknown fields during argo submit & lint (issue #892)
• Allow scaling of workflow and pod workers via controller CLI flags (issue #962)
• Allow supplying of parameters from a file during argo submit (issue #796) (@vosmith)
• [UI] UI support/spinning clock for pending pods (@EdanSneh)

• Remove installer/uninstaller (issue #928)
• Update golang compiler to v1.10.3
• Update k8s dependencies to v1.10 and client-go to v7.0
• Update argo-cluster-role to work with OpenShift

• Fix issue where retryStrategy with DAGs fails, even if the step passes after retries (issue #885)
• Fix issue where sidecars and daemons were not reliably killed (issue #879)
• Redundant verifyResolvedVariables check in controller precluded the ability to use {{ }} in other circumstances
• Fix issue where retryStrategy with DAGs fails, even if the step passes after retries (issue #885)
• Fix outbound node metadata with steps templates causing incorrect edges to be rendered in UI
• Fix outbound node metadata with retry nodes causing disconnected nodes to be rendered in UI (issue #880)
• Error workflows which hit k8s/etcd 1M resource size limit (issue #913)
• [UI] Fixed 'X' hiding under page (@EdanSneh)
• [UI] Beautified resource template. Yaml will now indent 2 spaces instead of one space

v2.1.1

Changelog since v2.1.0

• Switch to an UnstructuredInformer to guard controller against malformed workflow manifests (issue #632)
• Fix issue where suspend templates were not properly being connected to their children (issue #869)
• Fix issue where a failed step in a template with parallelism would not complete (issue #868)
• Fix issue where argo list age column maxed out at 1d (issue #857)
• Fix issue where volumes were not supported in script templates (issue #852)
• Fix implementation of DAG task targets (issue #865)
• Retrying failed steps templates could potentially result in disconnected children
• [UI] Fix crash while rendering failed workflow with exit handler (issue #815)
• [UI] Fix locating outbound nodes for skipped node
• [UI] Fix JS crash caused by inconsistent workflow state
• [UI] Fix blank help page when using browser navigation
• [UI] API server can filter workflows managed by specific workflow controller (@kzadorozhny)
• [UI] Restore support for accessing the UI using kubectl proxy (@mthx)
• [UI] Pass the namespace when querying the logs (issue #777) (@mthx)
• [UI] Improve workflow sorting (issue #866)

• Add windows support for Argo CLI (@cuericlee)

• Documentation fixes (@mthx, @bodepd)

v2.1.0

Changelog since v2.0

• Support for DAG based definition of workflows
• Add spec.parallelism field to limit concurrent pod execution at a workflow level
• Add template.parallelism field to limit concurrent pod execution at a template level
• Add argo suspend, argo resume to suspend and resume workflows
• Add argo resubmit to resubmit a failed workflow
• Add argo retry to retry a failed workflow with the same name
• Add --instanceid flag to argo submit command to submit workflow with controller's specific instance id label
• Add --name and --generate-name to override metadata.name and/or metadata.generateName during submission
• Add argo logs -w to support rendering combined workflow logs
• Experimental support for resubmitting workflows with memoized steps
• Improved parameters and output validation
• UI migrated to React
• Workflow details page redesigned: added DAG view support, added workflow timeline tab.
• Workflow details page enhancements: added sidecar containers details; workflow exist handler is available on DAG diagram and timeline view.
• Support for pod tolerations (@discordianfish)
• Make workflow.namespace available as a global variable (@vreon)
• Support for exported global output parameters and artifacts
• Trim a trailing newline from path-based output parameters
• Add ability to reference global parameters in spec level fields
• Make {{pod.name}} available as a parameter in pod templates
• Argo CLI shell completion support (@mthx)
• Add ability to pass pod annotations and labels at the template levels (@wookasz)
• Add ability to use IAM role from EC2 instance for AWS S3 credentials (@wookasz)

• Abstract the container runtime as an interface to support mocking and future runtimes
• Documentation and examples fixes (@IronPan, @dmonakhov, @bodepd, @mthx, @javierbq, @sebdoido)
• Rewrite the installer
• install & uninstall commands use --namespace flag (@Fitzse)
• Trim spaces from aws keys (@bodepd)
• Update base image to debian 9.4 (from 9.1) (@mthx)

• Global parameters were not referenceable from artifact arguments
• spec.arguments are optionally supplied during linting
• Fix for CLI not rendering edges correctly for nested workflows
• Fix template.parallelism limiting parallelism of entire workflow
• Fix artifact saving to artifactory (@dougsc)
• Use socket type for hostPath to mount docker.sock (@DSchmidtDev)
• Fix rbac resource versions in install (@dvavili)
• Fix input parameters on a steps template prevent daemon pods from terminating (@adampearse)
• Fix locating outbound nodes for skipped node (issue #825)
• Avoid println which outputs to stderr (@mthx)
• Fix issue where daemoned steps were not terminated properly in DAG templates

v2.1.0-beta2

• argo installdoes not install argo ui deployment