This document lists all relevant changes applied over time to TIXstreami MFT packages and their software components. Each entry in the list shows changes made to the Services, the installation Bundle or the Documentation. Entries may have an ID at the end of the line for internal reference.

Software Version - Document Version: v1.8.0-1.4

The following abbreviations are used:

  • TJM: Transfer Job Manager

  • TCC: Tixel Control Center

  • AM: Access Manager

  • TXS: TIXstream

Version 1.8.0 (2019-07-05)

Module Versions

  • TJM: v1.6.0 → 1.7.1

  • TCC: v1.7.0 → 1.8.0

  • AM: v1.6.2

  • TXS: v4.8.0 → 4.10.0

NEW

  • New file IO type ("Windows") can be selected in TCC that significantly improves performance to CIFS storage on Windows platforms (TXS, TJM, TCC)

  • Ubuntu 18 support

  • IPv6 support (TXS)

    • Please note that localhost needs to be resolvable unambiguously, which is not the case by default on some platforms

  • Improved logging (TXS)

FIXED

  • Several stability improvements for heavy duty concurrency scenarios (TXS)

  • TIXstream transfer engine in v1.7.0 used to spontaneously stop in the middle of a transfer in some system configurations (TXS)

  • Integrated DB schema migration fixed to support updates from v1.2.x (TJM)

CHANGED

  • Current data rate calculation is done in a 5 sec instead of 60 sec window (TXS)

  • CentOS 7 versions smaller than 7.4 are not supported

  • To connect to TIXstream FX a TIXstream FX version 1.7.3 or newer is required

Documentation 1.4 (2020-03-10)

Documentation 1.3 (2020-01-09)

  • Reference to OpenJDK installation sources for Windows added in Installation Guide

  • Added hint on 'create-report' scripts in Quick Start Guide

  • Several details added to update guide Updating from v1.2.x

Documentation 1.2 (2019-08-01)

  • Several details added to update guide Updating from v1.2.x

    • Corresponding links added to Installation Guide

Documentation 1.1

  • Missing Update section for v1.6.1→v1.7.0 added

    • Extra section for special Pixspan related update steps added

  • Ubuntu 18.04 specific installation steps added in Quick Start Guide and Installation Guide

  • New document that describes updating from v1.2.x added (see Updating From v1.2.x)

Version 1.7.0 (2018-09-29)

Module Versions

  • TJM: v1.5.2 → v1.6.0

  • TCC: v1.6.1 → v1.7.0

  • AM: v1.6.2

  • TXS: v4.7.1 → 4.8.0

NEW

  • New options to allow creation of fine grain performance log data to optimize throughput or detect bottlenecks (TXS)

    • Add e.g. perf-stats-path = /opt/tixel/data/tixstream on Linux or perf-stats-path = data/tixstream on Windows to tixstream.conf

  • New additional licensing options to allow more cost efficient licensing of certain features (TXS)

    • Add e.g. license-type = 380 to tixstream.conf for and evaluation license (valid values: 0,1,100,380,5100,5101,5102)

    • Add e.g. max-licensed-bandwidth = 5000 to tixstream.conf for a professional license with a supported bandwidth of 5Gbps

FIXED

  • Node policies can be changed now even if RWTP is not enabled in tixel-control-center.properties file (TCC)

  • History tab in dashboard now shows correct number of search results and has improved filter options (TCC)

  • Several stability improvements for heavy duty concurrency scenarios (TXS)

  • When using query strings at API with pagination, number of search results and pagination is correct now (TJM)

CHANGED

Version 1.6.1 (2018-08-16)

Module Versions

  • TJM: v1.5.0 → v1.5.2

  • TCC: v1.6.0 → v1.6.1

  • AM: v1.6.2

  • TXS: v4.7.0 → 4.7.1

NEW

  • NGINX configuration contains more restrictive settings for HTTPS

FIXED

  • Leaking file handles have been removed and ulimit for files has been raised to 32k to fix "Too many open files" issue (TJM)

  • Credentials for notification receiver were not persisted correctly (TJM, TCC)

  • In some cases a receiver could not start a created job due to a race condition (TJM)

  • TIXstream logs were sometimes filled with "ACE_MESSAGE_BLOCK" strings

CHANGED

  • Limit of a maximum of 10 parallel sessions has been removed in TIXstream to support massive parallel transfers (TXS)

Version 1.6.0 (2018-05-07)

Note
 Due to added support for popular MariaDB 10.2 database the DB migration scripts for some supported databases needed to be adapted. So please carefully check the Update section in TIXstream MFT Installation Guide

Module Versions

  • TJM: v1.4.0 → v1.5.0

  • TCC: v1.5.0 → v1.6.0

  • AM: v1.6.2

  • TXS: v4.6.0 → 4.7.0

NEW

  • Configuring datarate limit is now also supported when using XP as datachannel protocol (TXS)

  • Linux install script can be provided with a umask parameter (bundle)

  • I/O Performance of (S)FTP shares is significantly improved (TXS)

  • separate script to install/update IRT BMF metadata editor included (bundle)

  • Example profiles for high performance multi-Gigabit transfers with RWTP included (bundle)

FIXED

  • Data integrity option works now also with I/O types sequential, with (S)FTP shares and when using "read-while-write" mode (TXS)

  • Issue due to a race condition during concurrent job creation solved (TJM)

  • Some API client calls for TIXstream FX relay job processing fixed (TJM)

CHANGED

  • Database schema and migration script (TJM)

  • Transfer tab is placed next to Dashboard tab in admin view (TCC)

  • async I/O is not yet supported in TIXstream 4, so corresponding I/O type option has been removed in "Shares" tab (TCC)

  • Coloring of jobs with successful/unsuccessful integrity check is improved (TCC)

  • Timeout handling in TIXstream transfer engine has been streamlined and can be configured globally via option --datachannel-timeout in tixstream.conf (value in seconds, default is 60s). Settings in sender and receiver profiles are ignored now. (TXS)

Documentation v1.1 (2018-08-16)

  • Provide several fixes and clarifications throughout entire doc package

  • Move section about Windows cluster configuration to separate document

Documentation v1.0

Version 1.5.0 (2018-03-12)

Updated Module Versions

  • Transfer Job Manager v1.4.0

  • TIXEL Control Center v1.5.0

  • TIXstream v4.6.0

Unchanged Module Versions

  • Access Manager v1.6.2

  • TIXEL Metadata Editor v0.1.0

  • mftctl v0.2.0

Bundle

  • NEW: TJM now includes a configurable watch folder module

  • NEW: Several settings have been explicitly added to config, properties and profile files, so that adaptation becomes easier

  • CHANGED: TIXstream and NGINX settings have been adapted to support large file lists (about 1 mio entries are now possible - before 100000)

TCC

  • NEW: New watch folder configuration tab can be enabled/disabled:

    • default: custom.tcc.watchfolder-configuration-enabled=false

  • FIXED: CentOS6: TCC service did not get trust store password passed during startup

TJM

  • NEW: New watch folder module can be enabled/disabled:

    • default: custom.transfer-job-manager.watchfolder-enabled=false

    • New REST API endpoints for configuration are available (s. API documentation)

TIXstream

  • FIXED: Windows: Several Non-Latin unicode characters in file names and paths (especially from Asian character sets) caused transfers to fail

  • FIXED: In rare cases a race condition during tear-down at the end of a transfer caused transfers to "hang" when almost finished

Documentation

  • Fix minor formatting issues

Version 1.4.3 (2018-02-09)

Service Versions

  • Access Manager v1.6.2

  • Transfer Job Manager v1.3.3

  • TIXEL Control Center v1.4.0

  • TIXstream v4.5.5

  • TIXEL Metadata Editor v0.1.0

  • mftctl v0.2.0

Bundle

  • FIXED: Linux: install script did not have usage description for new parameters '-u' and '-g'

  • FIXED: Linux: Services that rely on local MySQL DB installation might fail during startup if DB process was not running. Now, if a local MySQL service is installed, it will be started before TIXstream MFT services.

TIXstream/TJM

  • FIXED: Some USB dongle based license schemes were interpreted incorrectly and caused a license error

  • FIXED: Linux: 'umask' settings were not applied during file and folder creation

  • FIXED: CentOS6: TIXstream service sometimes spuriously showed FAILED during startup

  • FIXED: CentOS6: TIXstream initd script did not respect custom user/group settings during installation

  • FIXED: CentOS6: TJM service did not get trust store password passed during startup

Documentation

  • Fix minor formatting issues

Version 1.4.2 (2018-01-18)

Service Versions

  • Access Manager v1.6.2

  • Transfer Job Manager v1.3.2

  • TIXEL Control Center v1.4.0

  • TIXstream v4.5.3

  • TIXEL Metadata Editor v0.1.0

  • mftctl v0.2.0

Bundle

  • FIXED: Install script did not set user/group parameters in systemd unit files when provided on the command line

Version 1.4.1 (2017-01-14)

Service Versions

  • Access Manager v1.6.2

  • Transfer Job Manager v1.3.2

  • TIXEL Control Center v1.4.0

  • TIXstream v4.5.3

  • TIXEL Metadata Editor v0.1.0

  • mftctl v0.2.0

Services

TJM

  • FIXED: Final checksum calculation after job completion led to false alarm for transfers between Linux and Windows systems

TIXstream

  • FIXED: In rare cases AES IV calculation for data channel encryption caused data corruption on destination systems with EL7

Version 1.4.0 (2017-11-14)

Service Versions

  • Access Manager v1.6.2

  • Transfer Job Manager v1.3.0

  • TIXEL Control Center v1.4.0

  • TIXstream v4.5.0

  • TIXEL Metadata Editor v0.1.0

  • mftctl v0.2.0

Bundle

  • Make scripts EL6/EL7 aware

  • Check Java version during installation

  • Polish create-report.sh script

  • EL7: add script to increase socket buffers for better RWTP performance

  • config: add default values to TIXstream profiles for RWTP, Checksum operations

  • config: reduce max incoming jobs from 4 to 2 to reduce potential friction/overhead when using RWTP

  • Add uninstall option to install script

  • Service user and group ID can now be provided during installation

  • TIXstream WAN transfer service installation is now in TIXEL_HOME directory

    • /opt/tixstream → /opt/tixel/tixstream

  • Some script and directory names have been harmonized

    • Installer: install_mft_bundle.sh→ install.sh

    • Admin scripts: ctl_tixel_services.sh → ctl-services.sh

    • Backup dir: /opt → /opt/.tixel.bak

    • TIXstream transfer-status/checksum persistence: /opt/tixel/tmp → /opt/tixel/data/tixstream

  • Change local TIXstream-TJM communication port from 50000 to 59999 to avoid conflicts with a parallel TIXstream 3.x installation

Services

TJM

  • Add data integrity check feature

  • Remove destination dir on cancel aynchronously

  • Reduce min schedule value to 1 second

  • Sync receiver RUNNING state on update progress

  • Reset retry counter on running state transition

  • Increase default timeouts of peer communication

  • Fix recursive source file uri update

  • Add online flag and last seen to destinations

  • Add auto update of destinations cache

  • Restrict destination refresh access to admin only

  • Share 1 thread pool in destination service to reduce number of threads

  • Add API documentation

TCC

  • Add data integrity check feature support

  • Make REST timeouts configurable

  • Increase default REST timeouts

  • Create jobs asynchronously with wait for publish

  • Add publish action for staged job

  • Add tera-, peta and exa byte support to file size converter

  • Style: fix style issues with dark theme

  • Fix node editor form layout

  • Set public uri to local path if empty

  • Remove online check and use new online flag instead

  • Add refresh destinations to node management

  • Add max file items per directory restriction, default 100k

  • Add dynamic sorting to flatfile browser

  • Add download button for meta data

  • Automatically refresh of tabs when switched between them

TIXstream

  • Datachannel protocol (XP/RWTP) can be set per transfer via soap call

  • Improved logging

    • Revealing more details in case of errors

    • Showing duration of possible long running operations

  • GZip compressed soap communication between master and slave

  • Configurable RWTP timeout options

  • Improved Infinity (read-while-write) timeout behavior

  • Some minor bugfixes and performance optimizations

Version 1.3.0 (2017-08-24)

Service Versions

  • Access Manager v1.6.1

  • Transfer Job Manager v1.2.0

  • TIXEL Control Center v1.2.0

  • TIXstream v4.3.0

  • TIXEL Metadata Editor v0.1.0

  • mftctl v0.1.0

Bundle

  • Add support for CentOS6/RHEL6

  • Encode supported OS in file name as "el" for Enterprise Linux to reflect CentOS and RHEL support

  • Replace IRT metadata editor with TIXEL metadata example plugin

    • Can be easily replaced with 3rd party editors like the BMF2 compliant one from IRT

  • New script to create a report for TIXEL support

    • s. TIXEL_HOME/admin/create_report.sh

  • Several additional configuration options for TIXstream and TJM added

    • The provided default values ensure compatibility with pre 1.3.0 versions

Services

TJM

  • Add new REST resource to optionally allow recursive folder transfer

  • Provide option to enable Pixspan compression/decompression during transfer

  • Add node based policy configuration for chunk size, streams, transfer strategy, encryption and Pixspan

  • Add mechanism for capability negotiation before each transfer

  • Add file IO type option for share configuration to use sync, async IO

  • Fix wrong data rate calculation for interrupted transfers

  • Add duration to job progress

  • Add RHEL6 init.d support

  • Make job folder creation configurable

  • Ignore trailing slashes in source file URIs

  • Only create metadata file at destination if metadata exist

New properties with corresponding default settings

+custom.transfer-job-manager.default-sending-chunk-size=1048576
+custom.transfer-job-manager.default-receiving-chunk-size=1048576
+custom.transfer-job-manager.default-sending-streams=10
+custom.transfer-job-manager.default-receiving-streams=10
+custom.transfer-job-manager.default-sending-data-rate=100
+custom.transfer-job-manager.default-receiving-data-rate=100
+custom.transfer-job-manager.default-encryption-policy=AVAILABLE
+custom.transfer-job-manager.default-pixspan-policy=NOT_AVAILABLE
+
+custom.transfer-job-manager.max-sending-chunk-size=67108864
+custom.transfer-job-manager.max-receiving-chunk-size=67108864
+custom.transfer-job-manager.max-sending-streams=100
+custom.transfer-job-manager.max-receiving-streams=100
+custom.transfer-job-manager.max-sending-data-rate=10000
+custom.transfer-job-manager.max-receiving-data-rate=10000
+
+custom.transfer-job-manager.create-job-folder=true
+custom.transfer-job-manager.overwrite-allowed=false

TCC

  • Add folder copy support

  • Add encryption policy configuration to node editor

  • Add Pixspan policy configuration to node editor

  • Add transfer strategy configuration to node editor

  • Add rhel6 support: add jvm parameter to init.d scripts

  • Add file-IO type support to share editor

  • Add duration field to completed tab and job editor

  • Convert ETA and duration format to hh:mm:ss

  • Convert size in job editor to user friendly unit

  • Do not allow admin or demo as maintenance user

  • Fix flat file browser bug allowing to browse outside root share folder (#6597)

  • Add option to configure alternative dark theme

  • Hide metadata tabs when metadata editor is disabled

  • Allow setting browser title to custom title

TIXstream

  • Optionally allow using Pixspan Image Compression as plugin

  • Optionally allow switching transfer protocol to RWTP

Tools

  • experimental version of commandline client for TJM included

    • s. TIXEL_HOME/mftctl/bin

Version 1.2.4 (2017-07-20)

Services

  • Access Manager v1.6.0

  • Transfer Job Manager v1.1.3

  • TIXEL Control Center v1.1.0

  • TIXstream v4.2.3

TJM

  • FIXED: Transfer Job Manager does not communicate user defined status in all job states.

  • Optional OAuth2 support to reduce LDAP requests

  • Improved handling of jobs that are not available at the peer (anymore)

TCC

  • Optional OAuth2 support to reduce LDAP requests

Bundle

Installer (Windows)

  • Latest Nginx Version 1.13.3 integrated

  • Nginx log file path fixed (not handled during a software update; Please replace lines in tixnginx.service: LogDirectory=logs\nginx with LogDirectory=..\logs\nginx

  • Support white space in paths in cluster configuration

  • Improved tixtray.exe tool to start/stop TIXEL services (now in TIXEL_HOME/tools)

Documentation

  • Separate documentation package available

Version pre 1.2.4

History maintained in project wiki - available upon request