history.txt

实现了一个基本的ETL

*******************************************************************************
                          CLOVER ETL - HISTORY of RELEASES
*******************************************************************************

REL 2-5-3
---------
+ DbConnection: explicit unregistering of JDBC drivers
+ WatchDog: explicit interruption of nodes for failed graph
+ SimpleCopy checkConfig uses deep validation of metadata equality
+ DBInputTable SQL queries parsing fixed
+ CTL datediff fixed

REL 2-5-2
---------
Changes/bug fixes:
+ metadata externalization fixed

REL 2-5-1
---------
Changes/bug fixes:
+ MergeJoin: new optional attribute ascendingInputs
+ MergeJoin: checking of inputs ordering
+ bugfixes

REL 2-5-0
---------
Changes/bug fixes:
+ JDBC connections has new DB customization
+ keyDuplicates attribute for DataIntersection component
+ clover engine JMX messaging was reworked
+ standardization of mapping syntax:DBOutputTable, DataGenerator, DB2DataWriter, XLSReader
+ standardization of join key: AproxMergeJoin
+ debugDirectory graph attribute was replaced by command line parameter identically called
+ new command line parameter "-nodebug" turns of all runtime graph debugging (e.g edge debugging)
+ all names have to satisfy pattern "[_A-Za-z_]+[_A-Za-z0-9]*"
+ DBInputTable supports incremental reading 
+ DBOutputTable can return number of updated records
+ XMLWriter features: useRootElement, singleLine, DTD, XSD location, namespaces
+ XMLWriter: better mapping schema (old schema is still valid, but not recommended)
+ removed byteMode attribute in Simple/RangeLookupTable
+ CloverDataWriter and CloverDataReader supports file name in format like other writers; compressData attribute is removed

REL 2-4-11
----------
+ minor bugfixes

REL 2-4-10
----------
+ fix bug with index_of in CTL
+ small bugfixes

REL 2-4-9
---------
+ fixed bug in NumericFormat - some numbers ware not correctly formatted

REL 2-4-8
---------
+ oracle bulkloader updated
+ CTL decimal problem fixed
+ xls minor bugfixes

REL 2-4-7
---------
+ minor bugfixes

REL 2-4-6
---------
Changes/bug fixes:
+ XSL Transformation component
+ support for namespaces in XmlXpathReader
+ normalizer transformation count() is called only once for each input record
+ minor bugfixes

REL 2-4-5
---------
Changes/bug fixes:
+ reading from a port/field for XmlXpathReader
+ writing to a port/field for XmlWriter
+ minor bugfixes

REL 2-4-4
---------
Changes/bug fixes:
+ new extension point for dictionary entry type

REL 2-4-3
---------
Release in particular repairing bugs from 2.4.2 version.

Changes/bug fixes:
+ MergeJoin - fix for left outer join
+ DBOutputTable - fix problem with order in fieldMap attribute
+ AnalyzeDB - added engine initialization 
+ minor bugfixes

REL 2-4-2
---------
Release in particular repairing bugs from 2.4.1 version.

Changes/bug fixes:
+ the Trash component has new charset parameter
+ update mysql jdbc driver, added postresql jdbc driver
+ minor bugfixes

REL 2-4-1
---------
Release in particular repairing bugs from 2.4.0 version.

Changes/bug fixes:
+ only minor changes for GUI release purpose (1.9.0)

REL 2-4-0
---------
Changes/bug fixes:
+ new wrapper SystemOutByteChannel protects System.out against close() 
+ sftp protocol support for readers which use multifile reader
+ possibility of copying ByteDataField as BLOB
+ new implementation of "partition by range" feature with range lookup table usage 
+ field unquoting before setting value by delimited and universal data parsers
+ the set of available functions in the Clover transformation language was extended:
	 - string remove_blank_space(string );
	 - string get_alphanumeric_chars(string,boolean,boolean);
	 - string translate(string, string,string );
	 - string join(anytype,....);
	 - boolean is_long(string)
	 - integer index_of(string, string, integer)
     - boolean try_convert(anytype, anytype, string)
     - numeric num2num(numeric, symbol) 
     - bool num2bool(numeric)
     - numeric bool2num(bool, symbol)
     - bool str2bool(string)
     - date long2date(long)
     - long date2long(date)
     - string to_string(anytype)
	 - byte base64byte(string)
	 - string byte2base64(byte)
	 - string bits2str(byte)
	 - byte str2bits(string)
	 - byte hex2byte(string)
	 - string byte2hex(byte)
+ Clover transformation language supports two new variable types, byte array and record
+ some components have new optional "rejected" port(s) (AproxMergeJoin, CheckForeignKey, DBJoin, LookupJoin)
+ DBConnection - for threadSafe connections java.sql.Connections are stored specifically for element ids 
	--> method getConnection() was replaced by getConnection(String)
	--> some classes (SQLDataParser, DBLookupTable) now work with java.sql.Connection 
		instead of org.jetel.connection.DBConnection
+ DBOutputTable accepts more queries at once; new jetel-sql query syntax introduced
+ DBOutputTable has new attribute "errorAction" - COMMIT or ROLLBACK on errors
+ StructureWriter has 3 input ports: "body", "header" and "footer". There can be different masks for each input port
+ all component attributes, which contain a java code or a Clover TL language code, are not resolved for special
	characters
+ new graph processing facility - GraphExecutor, GraphPool.
+ new component XmlWriter with example graphXmlWriter.grf
+ new component SpeedLimiter
+ XLSWriter can write to different sheets depending on record's value
+ data record metadata can specify a default field delimiter
+ the DataReader component recognizes too few or too many fields per record
+ the DataReader component has extended error port metadata - field number where an error occurs is attached
+ new JavaExecute component
+ new component attribute type - properties
+ ascending/descending flag in sort component can be specified per each key field

REL 2-3-4
---------
Release in particular repairing bugs from 2.3.3 version.

Changes/bug fixes:
+ only minor changes for GUI release purpose

REL 2-3-3
---------
Release in particular repairing bugs from 2.3.2 version.

Changes/bug fixes:
+ added a public method to the aggregate mapping parser, which creates the values of constants from
	their string representations

REL 2-3-2
---------
Release in particular repairing bugs from 2.3.1 version.

Changes/bug fixes:
+ fix in the clover TL - last line comment doesn't need to be finished with a new line character(s)
+ fix in DBLookupTable's caching algorithm

REL 2-3-1 
---------
Release in particular repairing bugs from 2.3.0 version.

Changes/bug fixes:
+ fixed race condition occurring during multiple concurrent accesses to one lookup table.

REL 2-3-0 commercial purpose release
---------
+ new extension point for build-in JDBC drivers - a JDBC connection now can be defined also via
	identifier of a build-in JDBC driver instead direct parameters 'dbDriver' and 'driverLibrary'
+ new engine plugin - 'org.jetel.jdbc', which now contains only MySQL build-in JDBC driver
+ the Dedup compoment has new rejected port, where all duplicated records are resent
+ the set of available functions in the Clover transformation language was extended
	- boolean is_blank(string)
	- boolean is_ascii(string)
	- boolean is_number(string)
	- boolean is_integer(string)
	- boolean is_date(string)
	- boolean remove_diacritic(string)
+ the javolution library was updated to the version 5.1
+ the commons-logging library was updated to the version 1.1
+ the DBLookupTable has new parameter "storeNulls", which determines whether the internal cache will
	store also a 'null' database response
+ method DataField.copyFrom() is now deprecated - developers should use setValue(DataField) instead
+ added new component "DB2 Data Writer" - DB2 bulk loader
+ added new component "Informix Data Writer" - Informix bulk loader
+ added new component "MSSQL Data Writer" - SQL Server bulk loader
+ most of the readers are able to read direct from STDIN - use '-' character in fileURL parameter for this purpose
+ most of the writers are able to write direct to STDOUT - use '-' character in fileURL parameter for this purpose
+ usage of the 'Check foreign key' component was slightly changed - check documentation
+ DateDataField corresponds with three database types (DATE,TIME,TIMESTAMP) depending on format string:
	- format contains only date (GyMwWDdFE) symbols - DATE
	- format contains only time (aHhKkmsSzZ) symbols - TIME
	- format contains date and time symbols - TIMESTAMP
	- format is empty - TIMESTAMP

REL 2-2-1
---------
Release in particular repairing bugs from 2.2.0 version.

Changes/bug fixes:
+ the running scripts were renamed from 'run[.bat]' to 'clover[.bat]'
+ the default tracking interval was shorted to two seconds
+ in the DataGenerator component randomFields attribute can have inside minimal and maximal values these characters :;|