history.txt

实现了一个基本的ETL

  a value has to be quoted
+ the StringUtils class has new split method
+ the OracleDataWriter better handles a directory path with whitespaces
+ few other small fixes

REL 2-2-0
---------
Changes/bug fixes:
+ all read/write components have an uniform set of available attributes 
  (i.e. dataPolicy, skipFirstLine, skipRows, numRecords, ...)
+ The examples package - example graphs are now distributed as an 'easy to use' eclipse project
+ engine binary release has this slightly different directory structure
  - [cloverETL]
    - [bin]      run scripts
    - [docs]     documentation, licenses
    - [lib]      clover engine and other dependant libraries
    - [plugins]  clover engine plugins
+ new shell/bat scripts for easy clover execution are present in the [bin] directory
+ the documentation was moved to wiki page
+ new implementation of Aggregate component
+ new range lookup table was added to the lookup engine plugin
+ the DBOutputTable component now supports new output port for auto-generated keys from database;
  only MySQL and Oracle databases are supported
+ new XML reader based on xPath technology was added - XPathReader
+ the clover engine plugin framework was extended by new extension point for TL functions
  - most of the TL functions were externalized to the new engine plugin tlfunction
+ the field metadata has new attribute auto_filling
+ the clover transformation language increases usability - supports sequences, lookup tables, lists, maps ...

REL 2-1-3
---------
Release in particular repairing bugs from 2.1.2 version.

Changes/bug fixes:
+ fixes mainly in internal transformation language - isnull() method now process also numeric fields
  and switch command does not ignore last default branch

REL 2-1-2
---------
Release in particular repairing bugs from 2.1.1 version.

Changes/bug fixes:
+ DBOutputTable component now properly recognizes empty cloverField parameter
+ DataGenerator component publics its parameter setters
+ support for sequences and lookup tables was introduced into clover transformation language
+ simple sequence now returns valid current value

REL 2-1-1
---------
Release in particular repairing bugs from 2.1.0 version.

Changes/bug fixes:
+ fix in Clover Data Reader and Clover Data Writer components
+ phase edges now correctly clean up temporary files

REL 2-1-0
---------
Changes/bug fixes:
+ Added new component "Data Generator" - generator of synthetic/random data
+ Added new component "Lookup Table Reader/Writer" - reader/writer of records from/to lookup table
+ Added new component "Lookup Join" - joins incoming data with selected lookup table
+ Added new component "JMS Reader" - receives JMS-messages
+ Added new component "JMS Writer" - sends JMS-messages
+ Added new component "Normalizer" - normalizes input records
+ Added new component "Denormalizer" - denormalizes input records
+ Added new component "Structure writer" - record mask formatter
+ Added new connection "JMS connection" - connection related with JSMReader and JMSWriter
+ developers can use new method for engine initialization - runGraph.initEngine()
+ new approach in DataField.setToDefaultValue() method;
  in case the default value is not preset, engine tries to set the field value to null
+ DBConnection has new calling method order;
  new DBConnection(), init(), getConnection()/getStatement(), free() 
  (connect() method is now private - call init() method instead)
+ Extended LookupTable interface by put() and remove() methods
+ all GraphElement(s) should implement checkConfig() method; this method is used for
  checking engine element configuration; related changes of transformation graph startup
  are described in runGraph class comments
+ components (Node descendants) should not override direct run() method, instead 
  for this purpose was introduced new execute() method
+ WatchDog thread has new wide logging and inter-component communication facilities
+ Added new data field type cbyte (compressed byte array)
+ All join components are ready to satisfy more slave input data streams

REL 2-0-4
---------
Release in particular repairing bugs from 2.0.3 version.

Changes/bug fixes:
+ fix in transform language for optional assigning 
+ Clover data writer was fixed for incoming empty record set

REL 2-0-3
---------
Release in particular repairing bugs from 2.0.2 version.

Changes/bug fixes:
+ all factories for pluginable graph elements (ComponentFactory, ConnectionFactory, ...)
  now are able to create instances by passing constructor parameters
+ all components with record transformation class (Reformat, HashJoin, ...)
  have a new contructor for direct supplying RecordTransform class

REL 2-0-2
---------
Release in particular repairing bugs from 2.0.1 version.

Changes/bug fixes:
+ SQL utils/library better cooperate with ByteDataField
+ All <GraphElement>Factories can recognize type attribute as full class specification
+ Added new attribute sqlStatementDelimiter in DBExecute component
+ Extended LookupTable interface by put() and remove() methods

REL 2-0-1
---------
Changes/bug fixes:
+ Added new component "Oracle Data Writer" - oracle bulk loader
+ Added new component "MySQL Data Writer" - mysql bulk loader
+ Added new component "Clover Data Reader" - data reader for Clover internal format
+ Added new component "Clover Data Writer" - data writer for Clover internal format
+ Added new component "LDAP Reader" - data extractor from LDAP directory
+ Added new component "LDAP Writer" - data loader to LDAP directory
+ Added new component "XLS Reader" - excel sheets reader
+ Added new component "XLS Writer" - excel sheets writer
+ DelimitedDataReader and FixLenDataReader can read from multifile specified by wildcard patterns
+ FixLenDataParser has two different reading mode - byte and char mode
+ XMLExtract now operates with multifield keys and generated key by sequence

REL 2-0-0
---------
Changes/bug fixes:
+ CloverETL now requires Java 1.5 (or higher) to run
+ New plugging system introduced (see CloverETL web site, documentation section) - all components,
connections, lookups, sequences are now implemented as independent plug-ins of CloverETL
+ Behaviour of setNull() method on DataField(s) is changed - may result in calling setDefault()
depending on nullability flag
+ ByteDataField should now be working (many bugs have been fixed)
+ Transformation language has been greatly extended and thoroughly tested
+ Aggregate component now supports two more "aggregation functions" (CRC32 and MD5)
+ CloverETL now distinguishes between "core" components developed by CloverETL team and third
party contributions - they are kept in separate "project"
+ BadDataFormatException handling has been reworked - see the source code for more info 
+ Encryption of passwords in db connections has been reworked - see org.jetel.main.runGraph JavaDoc
for new command-line option
+ StringDataField now uses StringBuilder class to store its value
+ "old" FixLenDataParser has been replaced by two new parsers - FixLenCharDataParser/FixLenByteDataParser

Note: for additional changes between "old" 1.x and "new" 2.x versions see documentation
bundled with source code package.

REL 1-9-0
-------------
Changes/bug fixes:
+ Removed Singleton pattern from TransformationGraph class - Clover now supports unlimited
graphs within single JVM instance
+ Added DataReader/DataWriter - universal readers/writers of text files - support
mixture of delimited & fix-len fields, able to survive errors in data
+ Added Transformation language - full-fledge programming language focused on creating
data transformations (supported by Reformat, all joiners, DataIntersection components) -
warning - this is still very untested. Examples will follow. 
+ Added option "fastPropagate" to Edge - allows fast propagation of records between
components connected by such edge - different kind of buffering involved when reader
can read data just after they are sent by writer. Normally, reader waits till writer
fills-in the buffer fully.


REL 1-8-3
---------
Changes/bug fixes:

+ loading definition of custom transformation components in org.jetel.main.runGraph()
  (added option to load/register additional transformation components)
+ fixed bug in fromXML() method which caused "Can't find <SQLCode> node !" error in graphs developed in GUI
+ set equalNulls parameter of dedup component to be true as default.
+ DBConnection now supports drivers consisting of multiple Java libraries
  (added option to specify more than one library when loading JDBC driver  - in connection definitions (driverLibrary) )
+ re-tested and fixed many problems in org.jetel.data.DecimalDataField and related classes
+ fixed hasData() method in DirectEdge implementation which sometimes caused component hang-on
+ fixed missing close() call on output stream in Trash component when output was directed to file


REL 1-8-2
---------
Changes/bug fixes:
+ fixed FixLenDataParser2 which was discarding all records
+ fixed CopySQLData.CopyDate when used with Oracle 10 driver (DBOutputTable component) 
+ fixed	DBInputTable when used with DB2 JDBC driver - now calling commit() on result set (applies to all DBs)


REL 1-8-1
---------
Changes/bug fixes:
+ fixed DirectEdge problem which caused component hang-up
+ fixed DelimitedReaderNIO problem when reading UTF-8 encoding (and other multi-byte character encodings)
+ improved reporting of parsing errors for DelimitedDataReaderNIO and FixLenDataReader


REL 1-8-0
---------
The version numbering has changed. Starting with this version (1.8.0), the third part of version
number will be used to distinguish bug-fixes between regular versions - if such release is needed.
Second part is used to distinguish regular releases. First part of the number (e.g. 1) is changed when
substantial architecture change was made.

New features:
+new implementation of DirectEdge (the most common connection between components)
brings substantial improvement in performance - especially on SMP systems
+new data type - Decimal - implemented. It brings really big numbers to Clover.
+Clover implements its own  "primitive" numeric data types - Integer, Long, Double
which allow (in contrary to Java's own) modifications of stored values
+Reformat,HashJoin and MergeJoin components now support definition of mappings
written in form of enhanced Java syntax  

Changes:
+CodeParser has been updated to handle preprocessing of embedded "Clover" code in Java
source code

REL 1-1-7
---------
New features:
+added NVL() function to internal language used by filter component
+added JetelVersion class (in org.jetel.util) with several
static methods (and vars) which can be used to get info about library
version, build number, time of assembly, etc.
+added option to use encrypted passwords in JDBC config files
+all components now accept XML definition of parameters as XML attributes
or inner XML nodes
+framework Defaults (org.jetel.data.Defaults) are now set/configured through
defaultProperties file (in org/jetel/ directory of the binary package). It is no more
needed to recompile the whole package if (for example) the maximum size of data record
needs to be changed. Just edit the "defaultProperties" file.
+component factory is now configured through "components.xml" definition file. User