Skip to main content

Release Notes 2.0.0

Apache StreamPark (incubating) 2.0.0 is the first Apache version since StreamPark joined the ASF incubator. In this version, many new features have been added, and many bugs have been fixed. It is important for the stability and functionality of the entire product this A very big improvement, as follows:

Features


  • Ldap login support (#1181)
  • Add team management (#1265)
  • The front-end handles the exception display uniformly (#1281)
  • Build script support. (#1021)
  • Spark support. (#1338)
  • Support Flink 1.16 submit (#1938)
  • Support the team management (#1733)
  • Added variable management (#1850)
  • New WebUI ready based on vue3 (#2003)
  • i18n Support (#2088)
  • HOCON conf file support (#1968)
  • Unify flink configuration (#1858)
  • knox proxy cluster #1044 (#1052)
  • Verify flinksql support hive Dialect (#1170)
  • Remove unnecessary findUserRole (#1883)
  • Show the project build log in Web UI (#1673)
  • Execution run-mode support streaming and batch (#1670)
  • feishu, dingtalk, wecom alert support. (#1138)

Improvements


  • Kerberos httpclient support (#1090)
  • Database postgres support (#1457)
  • Simplify checkpoint/state related configuration (#1755)
  • Simplify restartStrategy related configuration (#1749)
  • Simplify the configuration of runtime-mode and parallelism-default (#1764)
  • Simplify the configuration of watermark interval (#1745)
  • Split each version of sql-upgrade.sql into a different directory (#1696)
  • Sender Email takes effect immediately when the configuration is modified (#1586)
  • The common module avoids using Flink api (#1763)
  • Unified swagger api docs description (#2096)
  • Update mysql upgrade sql (#1651)
  • after change team the routers need to be regenerated (#1868)
  • applist search-box improvement (#1271)
  • change app name synchronously when changing k8s-clusterId (#1221)
  • check savepoint path improvement.
  • deploy flink on k8s job-state improvement
  • flink on k8s metric-watcher improvement (#1292)
  • flinksql syntax improvement and testcase added (#1237)
  • maven dependency optimization (#1014)
  • workspace class Improvement (#1928)
  • front-end api-exception improvement (#2031)
  • get appname improvement (#2075)
  • history upload-jars improvement (#2114)
  • on k8s mode kubernetes.container.image.pull-policy improvement (#2057)
  • support paging in other database (#1475)
  • Precision state judgment based on archive logs (#1910)

Bugfix


  • fix same name udf updated, it can't work(#1204) (#1273)
  • parse create function syntax bug fixed. (#1216)
  • kerberos getLoginUser bug fixed .#1030 (#1055)
  • Added SUSPENDED button and removed FINISHED redundant configuration(#1176) (#1940)
  • After building the project, the build time is not updated (#2058)
  • An error is reported when the mysql upgrade sql statement is executed #2048 (#2050)
  • Depend Apps button permission control failed (#1971)
  • Failed to mark the latest savepoint and checkpoint #1989 (#1991)
  • Fix Copy is missing projectid and moudle bug fixed (#1498)
  • Fix pop-up window shows flink-conf.yaml bug #1420 (#1421)
  • Fix streampark login failure when switching postgres data sources (#1461)
  • Fix the SavePointMapper obsolete @update latest type bug (#1540)
  • Fix the Latest checkpoint not updated when job restart in K8S mode bug (#1476)
  • Fix the NPE bug and refactor some code (#1656)
  • Fix the help when user/role name already exists (#1635)
  • Fix the job cannot be start due to wrong type (#1825)
  • Fix the mapping between alarmType and implement class(#2046)
  • Fix the mysql field name bug (#1483)
  • Fix the tail buffer memory leak (#1664)
  • Fix the wrong duration (#1585)
  • Flink auto recover taskmanager failed #1175 (#1178)
  • Flink cluster cannot modify the flink version #1992 (#1993)
  • StreamPark cannot search for failed status tasks (#1917)
  • Taskmanager memory usage statistics calculation error on yarn mode #1061 (#1065)
  • The configured value cannot be cleared in the System Setting module #2084 (#2085)
  • The copy function of the application does not copy the args information (#2083)
  • The yarn-queue parameter is specified but does not take effect (#1330)
  • dynamicProperties env.java.opts not support bug fixed (#2019)
  • extractProgramArgs parsing args parameter error (#1652)
  • find jar in error path #1060 (#1064)
  • fix delete job bug fixed (#1391)
  • fix spark build error caused by scala 2.11 (#1331)
  • fix yarn session address config loss (#1312)
  • fixed 'Kube Conf File' param can not displayed at Flink Cluster Edit Page (#1879)
  • fixed the ignore restored option bug (#1839)
  • flink cluster management bug fixed (#2100)
  • flink-job archivefile parse bug fixed (#2094)
  • front-end enum bug fixed (#2023)
  • generate pom with correctly parsed version (#2151)
  • get param from application config bug fixed. (#2165)
  • http client default auth #1075 (#1078)
  • init config filter null value (#1963)
  • project list modules bug fixed (#2026)
  • should use fromYamlFile function to read conf file in flink 1.15 shims (#1410)
  • submit flink job argument type mismath #1165 (#1182)
  • support flinksql set syntax (#1926)
  • update mysql.version from '8.0.16' to '8.0.27' as CVE-2021-2471. (#2141)
  • yarn kerberos acl #1046 (#1053)
  • yarn-queue don't work fixed (#1332)
  • Fixed some job properties are not replicated bug When copy a job (#1559)
  • Non-admin user can't login problem fixed (#1346)
  • fix custom savepoint address reading failed on canceling job bug (#1433)
  • fixed the build.sh bug (#1916)
  • application conf bug (#2035)
  • cluster edit bug ,header show lock (#2098)
  • copy api bug fix (#2125)
  • fix application create bug and add variable preview (#1927)
  • fix variable drawer bug,fix dark theme style bug (#2016)
  • handle history version error,improve login footer style (#1957)
  • history version compare bug,Fix option logs link jumping problem (#1995)
  • page style and application bug (#1903)
  • project list pagination error (#2155)
  • swagger interface call back-end interface can not get parameter values (#1601)
  • user modal gender bug, flinksql editor fullscreen (#2000)
  • username len and fix role error (#2005)
  • copy application miss param bug fix (#1503)
  • init ddl schema bug fixed. (#1472)
  • job build state bug fixed. (#1530)
  • kerberos tgtRefreshTime bug fixed. (#1542)
  • ldap login bug fixed. (#1507)
  • log4j conflict fixed. (#1478)
  • on k8s get metrics bug fixed (#1999)
  • postgresql schema ddl and init data bug fixed. (#1509)
  • primary key auto_increment bug fixed (#1469)
  • project query failure bug fixed
  • send alert job' monitor-url bug fixed.
  • yarn knox proxy unnecessary kerberos auth, just for page redirect (#1154)
  • yarn-session cluster in remote mode can't edit bug fixed (#1315)