How To create and update Databases using SchemaManager and SchemaUpdateSnippets

Version 5.1 by christoph_lechleitner@iteg_at on 2013-01-31 06.18:32

Preliminary

The SchemaManager (org.clazzes.jdbc2xml.schema.SchemaManager) and SchemaEngine provide means to maintain the database scheme of an application, allowing you to add and delete tables, columns, relations and data in the database along application updates.

Schema History Table

A designated schema table, by default named SCHEMA_HISTORY, is used to keep track of the current scheme. It will be automatically at SchemaManager's first run. SCHEMA_HISTORY contains the following columns:

VERSION:varchar(10), not null, primary key
DESCRIPTION:varchar(512), nullable
CREATION_DATE:date, nullable
SERIALNR:integer(5), not null

In heterogenous environments as well as in heavily modularized software architectures a single database may be shared by multiple parties each requiring a couple of tables.

To allow multiple modules (applications, libraries, other OSGi bundles) to use JDBC2XML's SchemaManager concurrently within one database, as of JDBC 1.1.1 SchemaManager hold the name of the schema history table in an overwritable property, versionHistoryTable. See JDBCTOXML-11.

Project Configuration

SchemaManager requires a DataSource (javax.sql.DataSource) and a list of TableInfo (org.clazzes.jdbc2xml.schema.TableInfo) Objects, from which database structures will be created if an "empty" database is detected. Furthermore, an implementation of ISchemaEngine (org.clazzes.jdbc2xml.schema.ISchemaEngine) is required.

Optionally, a base version (default value 0.1.00) and a base description String (default "initial database schema") may be specified.

Database updates are passed as a Map<String, ISchemaUpdateSnippet> (org.clazzes.jdbc2xml.schema.ISchemaUpdateSnippet) - details see below.

To perform the operations, call SchemaManager.start().

Configuration using Spring or OSGi/Blueprint

If you are using OSGi with Blueprint or Spring to set up your project, you can configure a SchemaManager instance by adding the following to your blueprint services.xml (or Spring configuration file):

<bp:reference id="dialectFactory" interface="org.clazzes.jdbc2xml.schema.IDialectFactory">
</bp:reference>
 
<bp:reference id="schemaEngineFactory" interface="org.clazzes.jdbc2xml.schema.ISchemaEngineFactory">
</bp:reference>
 
<bp:bean id="sqlDialect" factory-ref="dialectFactory" factory-method="newDialect">
<bp:argument ref="jdbcUrl"><!-- bean jdbcUrl specified above -->
</bp:argument>
</bp:bean>
 
<bp:bean id="schemaEngine" factory-ref="schemaEngineFactory" factory-method="newSchemaEngine">
<bp:property name="dialect" ref="sqlDialect">
</bp:property>
</bp:bean>
 
<bp:bean id="databaseSetup" class="org.clazzes.jdbc2xml.schema.SchemaManager" init-method="start">
<bp:property name="dataSource" ref="dataSource"></bp:property>
<bp:property name="schemaEngine" ref="schemaEngine"></bp:property>
    <!-- optional but recommended: special name for schema history table: -->
    <bp:property name="versionHistoryTable" value="MYLIB_SCHEMA_HISTORY"/>
    <!-- optional but recommended: explicit first version -->
<bp:property name="baseVersion" value="0.1.00" />
<bp:property name="baseTables">
<!-- List of TableDefinitions here (see below), typical: -->
        <!-- <bp:bean factory-ref="tableDefinitions" factory-method="getSetup" /> -->
</bp:property>
    <!-- Add Update-Snippets here, example for updates from 0.1.00 to 0.1.01 and on to 0.2.00
<bp:property name="upateSnippets">
<bp:map>
            <bp:entry key="0.1.00" value="foo.schema.SchemaUpdate_0_1_01"></bp:entry>
            <bp:entry key="0.1.01" value="foo.schema.SchemaUpdate_0_2_00"></bp:entry>
</bp:map>
</bp:property>
    -->
</bp:bean>

By default, JDBC2XML provides an implementation of IDialectFactory and ISchemaEngineFactory as an OSGi service or via ServiceRegistry for Spring.

Setting up an initial database schema

To create an initial database schema, SchemaManager needs a list of TableInfo objects.

The recommended strategy is to implement a table definition class providing this list through a getter.

This is an example:

package org.clazzes.example.jdbc2xml;

import java.sql.Types;
import java.util.Arrays;
import java.util.List;

import org.clazzes.jdbc2xml.schema.ColumnInfo;
import org.clazzes.jdbc2xml.schema.ForeignKeyInfo;
import org.clazzes.jdbc2xml.schema.PrimaryKeyInfo;
import org.clazzes.jdbc2xml.schema.TableInfo;
 
public class TableDefinitions {

   // It is adviseable to provide the Strings used as names for tables and columns as constants, so they can be reused outside this object to build sql-statements
   public static final String TB_EXAMPLE_TABLE_NAME = "ADDRESSBOOK";
   public static final String COL_EXAMPLE_ID = "ID";
   public static final String COL_EXAMPLE_NAME = "NAME";
   public static final String COL_EXAMPLE_ADDRESS_REF = "ADDRESS";
   public static final String COL_EXAMPLE_BIRTHDAY = "BIRTHDAY";
 
   // ...
 
   private List<TableInfo> setup;

   public TableDefinitions() {
// Create a table
TableInfo exampleTable = new TableInfo(TB_EXAMPLE_TABLE_NAME);
exampleTable.setColumns(
            Arrays.asList(new ColumnInfo[] {
new ColumnInfo(COL_EXAMPLE_ID, Types.BIGINT, 20, null, false, null,true),
new ColumnInfo(COL_EXAMPLE_NAME, Types.VARCHAR, 256, null, false, null),
new ColumnInfo(COL_EXAMPLE_ADDRESS_REF, Types.BIGINT, 20, null, true, null),
new ColumnInfo(COL_EXAMPLE_BIRTHDAY, Types.DATE, 12, null, false, null)
}));
 
// Example for creating a foreign key reference
exampleTable.setForeignKeys(Arrays.asList(new ForeignKeyInfo[] {
new ForeignKeyInfo("FK_EXAMPLE_ADDRESS", COL_EXAMPLE_ADDRESS_REF, TB_ADDRESS, COL_ADDRESS_ID)
}));
 
// Example for creating a primary key
exampleTable.setPrimaryKey(
new PrimaryKeyInfo("PK_EXAMPLE", COL_EXAMPLE_ID)
);

// ...
 
this.setup = Arrays.asList(
exampleTable,
// ...
);

   }
    
   public List<TableInfo> getSetup() {
return this.setup;
   }

}

You must inject TableDefinitions.getSetup() into SchemaManager.setBaseTables() before calling SchemaManager.start().

Using Blueprint/Spring, you can do this by inserting the following snippet in the bean definition for SchemaManager:

<!-- SchemaManager bean definition starts here ... -->
<bp:property name="baseTables">
<bp:bean factory-ref="tableDefinitions" factory-method="getSetup" />
</bp:property>
<!-- ... and continues here -->

Updating a database schema with ISchemaUpdateSnippet

To update the database or it's content with schema updates, you must create a new implementation of ISchemaUpdateSnippet (org.clazzes.jdbc2xml.schema.ISchemaUpdateSnippet) for each consecutive update. SchemaManager takes a Map<String, Class<? extends ISchemaUpdateSnippet>> which contains the update classes keyed by the originating (e.g. previous) version.

An example for an implementation of a schema update snippet could look like this:

package org.clazzes.example.jdbc2xml.updates;

import java.sql.SQLException;
import java.sql.Types;
import java.util.Arrays;
import org.clazzes.jdbc2xml.schema.ColumnInfo;
import org.clazzes.jdbc2xml.schema.ISchemaEngine;
import org.clazzes.jdbc2xml.schema.ISchemaUpdateSnippet;
import org.clazzes.jdbc2xml.schema.PrimaryKeyInfo;
import org.clazzes.jdbc2xml.schema.TableInfo;

public class SchemaUpdate0_1_01 implements ISchemaUpdateSnippet {
 
// This is only accessed through the getter
private static final String TARGET_VERSION = "0.1.01";
 
// Here it is also adviseable to define constants for reuse in statements.
public static final String COL_EXAMPLE_GENDER = "GENDER";


@Override
public String getTargetVersion() {
return TARGET_VERSION;
}

@Override
public String getUpdateComment() {
return "Adding column "+COL_EXAMPLE_GENDER+" to table "+TableDefinitions.TB_EXAMPLE_TABLE_NAME+".";
}

@Override
public void performUpdate(ISchemaEngine schemaEngine) throws SQLException {
TableInfo ti = schemaEngine.fetchTableInfo(TableDefinitions.TB_EXAMPLE_TABLE_NAME, null);
        schemaEngine.addColumn(ti, new ColumnInfo(COL_EXAMPLE_GENDER, Types.VARCHAR, 1, null, true, null));
}
}

The return values of ISchemaUpdateSnippet.getTargetVersion() and ISchemaUpdateSnippet.getUpdateComment() are written to the SCHEMA_HISTORY table. The update itself is performed in ISchemaUpdateSnippet.performUpdate(). In the above example, it adds a column called GENDER to the example table created by the TableDefinitions class above.

To add an entire table you would use the ISchemaEngine.createTable() method, like this:

@Override
public void performUpdate(ISchemaEngine schemaEngine) throws SQLException {
        TableInfo tiGroup = new TableInfo(TB_GROUP);
        tiGroup.setColumns(Arrays.asList(new ColumnInfo[] {
               new ColumnInfo(TableDefinitions.COL_ID, Types.VARCHAR, 36, null, false, null),
               new ColumnInfo(TableDefinitions.COL_NAME, Types.VARCHAR, 100, null, false, null),
               new ColumnInfo(TableDefinitions.COL_DESCRIPTION, Types.VARCHAR, 512, null, true, null)
       }));
        tiGroup.setPrimaryKey(new PrimaryKeyInfo(PK_GROUP, TableDefinitions.COL_ID));
        tiGroup.setIndices(Arrays.asList(new IndexInfo(IDX_GROUP_01, TableDefinitions.COL_NAME, true, null)));

schemaEngine.createTable(tiGroup, true);
}

Executing a PreparedStatement also works, using ISchemaEngine.getConnection() to retrieve the database connection:

@Override
public void performUpdate(ISchemaEngine schemaEngine) throws SQLException {
        String sql = "UPDATE "+TableDefinitions.TB_EXAMPLE_TABLE_NAME+" SET "+TableDefinitions.COL_EXAMPLE_NAME+"=?";
       
        PreparedStatement ps = schemaEngine.getConnection().prepareStatement(sql);
       
        ps.setNull(1, Types.VARCHAR);
       
        ps.execute();
}

To create the map of updates in Blueprint/Spring and inject them into SchemaManager, use the following xml-Snippet:

<!-- SchemaManager bean definition starts here ... -->
<bp:property name="upateSnippets">
<bp:map>
<bp:entry key="0.1.00" value="org.clazzes.example.jdbc2xml.updates.SchemaUpdate0_1_01"></bp:entry>
<!-- more entries come here: "key" is the schema version to update, "value" the qualified classname of the schema update -->
</bp:map>
</bp:property>
<!-- ... and continues here -->