database/postgres
database/postgres
1
0
Fork 0
mirror of https://github.com/postgres/postgres.git synced 2025-04-20 00:42:27 +03:00
Code

Here the latest version and first working release of Ora2Pg a tool to export

Browse Source 
Oracle database to PostgreSQL.

    It currently dump the database schema (tables, views, sequences,
    indexes, grants), with primary, unique and foreign keys into PostgreSQL
    syntax without editing the SQL code generated. You can dump only a
    particular schema from the Oracle database.

    Functions, procedures and triggers with SQL or PLSQL code generated must
    be reviewed to match the PostgreSQL syntax. Some usefull recommandation
    on porting Oracle to PostgreSQL can be found at
http://techdocs.postgresql.org/
    under the "Converting from other Databases to PostgreSQL" Oracle part. I
just
    notice one thing more is that the trunc() function in Oracle is the same for
number
    or date so be carefull when porting to PostgreSQL to use trunc() for number
and
    date_trunc() for date.

I will add more precision in type NUMBER conversion based on length to match
as closest as possible all rich PostgreSQL numerics type. But it seems not to be

urgent as it seems that Oracle DBAs only create number with length 22 (default)
Space seems not to be their problem...

Gilles DAROLD
This commit is contained in:
Bruce Momjian 2001-06-23 02:56:23 +00:00
parent a0c12d5e90
commit 2e2d17ed51
6 changed files with 1283 additions and 484 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
contrib/oracle/CHANGES
View File

@ -4,7 +4,7 @@
- Add table grant extraction based on group. Oracle ROLES are groups in PG - Add table grant extraction based on group. Oracle ROLES are groups in PG
2001 05 11 - Version 1.2 2001 05 11 - Version 1.2
- Views extraction is now really done with the option type=>'VIEWS' - Views extraction is now really done with the option type=>'VIEW'
- Add indexes extraction on tables. - Add indexes extraction on tables.
- Changes name of constraints, default is now used. - Changes name of constraints, default is now used.
- Add debug printing to see that the process is running :-) - Add debug printing to see that the process is running :-)
@ -15,3 +15,13 @@
- Complete rewrite of the grant extraction - Complete rewrite of the grant extraction
- Complete rewrite of most things - Complete rewrite of most things
2001 06 20 - Version 1.3
- Grant/privilege extraction are now done separatly with the option type=>'GRANT'
- Sequence extraction with the option type=>'SEQUENCE'
- Trigger extraction with the option type=>'TRIGGER'
- Function extraction with the option type=>'FUNCTION' and type=>'PROCEDURE'
- Complete rewrite of the foreign key extraction
- Fix incorrect type translation and many other bug fix
- Add schema only extraction by option schema => 'MYSCHEM'

720
contrib/oracle/Ora2Pg.pm
View File

@ -61,7 +61,9 @@ or if you only want to extract some tables:
datasource => $dbsrc, # Database DBD datasource datasource => $dbsrc, # Database DBD datasource
user => $dbuser, # Database user user => $dbuser, # Database user
password => $dbpwd, # Database password password => $dbpwd, # Database password
tables => \@tables, # Tables to extract tables => \@tables,
or # Tables to extract
tables => [('tab1','tab2')],
debug => 1 # To show somethings when running debug => 1 # To show somethings when running
); );
@ -82,10 +84,14 @@ or if you only want to extract tables 10 to 20:
datasource => $dbsrc, # Database DBD datasource datasource => $dbsrc, # Database DBD datasource
user => $dbuser, # Database user user => $dbuser, # Database user
password => $dbpwd, # Database password password => $dbpwd, # Database password
min => 10 # Begin extraction at indice 10 min => 10, # Begin extraction at indice 10
max => 20 # End extraction at indice 20 max => 20 # End extraction at indice 20
); );
To choose a particular schema just set the following option to your schema name :
schema => 'APPS'
To know at which indices table can be found during extraction use the option: To know at which indices table can be found during extraction use the option:
showtableid => 1 showtableid => 1
@ -94,8 +100,29 @@ To extract all views set the option type as follow:
type => 'VIEW' type => 'VIEW'
To extract all grants set the option type as follow:
type => 'GRANT'
To extract all sequences set the option type as follow:
type => 'SEQUENCE'
To extract all triggers set the option type as follow:
type => 'TRIGGER'
To extract all functions set the option type as follow:
type => 'FUNCTION'
To extract all procedures set the option type as follow:
type => 'PROCEDURE'
Default is table schema extraction Default is table schema extraction
type => 'TABLE'
=head1 DESCRIPTION =head1 DESCRIPTION
@ -110,9 +137,16 @@ I'm not a Oracle DBA so I don't really know something about its internal
structure so you may find some incorrect things. Please tell me what is structure so you may find some incorrect things. Please tell me what is
wrong and what can be better. wrong and what can be better.
It currently only dump the database schema, with primary, unique and It currently dump the database schema (tables, views, sequences, indexes, grants),
foreign keys. I've tried to excluded internal system tables but perhaps with primary, unique and foreign keys into PostgreSQL syntax without editing the
not enougt, please let me know. SQL code generated.
Functions, procedures and triggers PL/SQL code generated must be reviewed to match
the PostgreSQL syntax. Some usefull recommandation on porting Oracle to PostgreSQL
can be found at http://techdocs.postgresql.org/ under the "Converting from other
Databases to PostgreSQL" Oracle part. I just notice one thing more is that the
trunc() function in Oracle is the same for number or date so be carefull when
porting to PostgreSQL to use trunc() for number and date_trunc() for date.
=head1 ABSTRACT =head1 ABSTRACT
@ -123,13 +157,13 @@ the connection parameters to the Oracle database.
Features must include: Features must include:
- Database schema export, with unique, primary and foreign key. - Database schema export (tables, views, sequences, indexes),
with unique, primary and foreign key.
- Grants/privileges export by user and group. - Grants/privileges export by user and group.
- Indexes and unique indexes export. - Table selection (by name and max table) export.
- Table or view selection (by name and max table) export. - Predefined functions/triggers/procedures export.
- Predefined function/trigger export (todo)
- Data export (todo)
- Sql query converter (todo) - Sql query converter (todo)
- Data export (todo)
My knowledge regarding database is really poor especially for Oracle My knowledge regarding database is really poor especially for Oracle
so contribution is welcome. so contribution is welcome.
@ -152,7 +186,8 @@ Supported options are:
- datasource : DBD datasource (required) - datasource : DBD datasource (required)
- user : DBD user (optional with public access) - user : DBD user (optional with public access)
- password : DBD password (optional with public access) - password : DBD password (optional with public access)
- type : Type of data to extract, can be TABLE (default) or VIEW - schema : Oracle internal schema to extract
- type : Type of data to extract, can be TABLE,VIEW,GRANT,SEQUENCE,TRIGGER,FUNCTION,PROCEDURE
- debug : Print the current state of the parsing - debug : Print the current state of the parsing
- tables : Extract only the given tables (arrayref) - tables : Extract only the given tables (arrayref)
- showtableid : Display only the table indice during extraction - showtableid : Display only the table indice during extraction
@ -206,7 +241,7 @@ sub export_schema
#### Private subroutines #### Private subroutines
=head1 PUBLIC METHODS =head1 PRIVATE METHODS
=head2 _init HASH_OPTIONS =head2 _init HASH_OPTIONS
@ -233,6 +268,9 @@ sub _init
$self->{limited} = (); $self->{limited} = ();
$self->{limited} = $options{tables} if ($options{tables}); $self->{limited} = $options{tables} if ($options{tables});
$self->{schema} = '';
$self->{schema} = $options{schema} if ($options{schema});
$self->{min} = 0; $self->{min} = 0;
$self->{min} = $options{min} if ($options{min}); $self->{min} = $options{min} if ($options{min});
@ -248,10 +286,23 @@ sub _init
# Retreive all table informations # Retreive all table informations
if (!exists $options{type} || ($options{type} eq 'TABLE')) { if (!exists $options{type} || ($options{type} eq 'TABLE')) {
$self->_tables(); $self->_tables();
} else { } elsif ($options{type} eq 'VIEW') {
$self->{dbh}->{LongReadLen} = 100000; $self->{dbh}->{LongReadLen} = 100000;
$self->_views(); $self->_views();
} elsif ($options{type} eq 'GRANT') {
$self->_grants();
} elsif ($options{type} eq 'SEQUENCE') {
$self->_sequences();
} elsif ($options{type} eq 'TRIGGER') {
$self->{dbh}->{LongReadLen} = 100000;
$self->_triggers();
} elsif (($options{type} eq 'FUNCTION') || ($options{type} eq 'PROCEDURE')) {
$self->{dbh}->{LongReadLen} = 100000;
$self->_functions($options{type});
} else {
die "type option must be TABLE, VIEW, GRANT, SEQUENCE, TRIGGER, FUNCTION or PROCEDURE\n";
} }
$self->{type} = $options{type};
# Disconnect from the database # Disconnect from the database
$self->{dbh}->disconnect() if ($self->{dbh}); $self->{dbh}->disconnect() if ($self->{dbh});
@ -264,6 +315,84 @@ sub _init
sub DESTROY { } sub DESTROY { }
=head2 _grants
This function is used to retrieve all privilege information.
It extract all Oracle's ROLES to convert them as Postgres groups
and search all users associated to these roles.
Set the main hash $self->{groups}.
Set the main hash $self->{grantss}.
=cut
sub _grants
{
my ($self) = @_;
print STDERR "Retrieving groups/users information...\n" if ($self->{debug});
$self->{users} = $self->_get_users();
$self->{groups} = $self->_get_roles();
$self->{grants} = $self->_get_all_grants();
}
=head2 _sequences
This function is used to retrieve all sequences information.
Set the main hash $self->{sequences}.
=cut
sub _sequences
{
my ($self) = @_;
print STDERR "Retrieving sequences information...\n" if ($self->{debug});
$self->{sequences} = $self->_get_sequences();
}
=head2 _triggers
This function is used to retrieve all triggers information.
Set the main hash $self->{triggers}.
=cut
sub _triggers
{
my ($self) = @_;
print STDERR "Retrieving triggers information...\n" if ($self->{debug});
$self->{triggers} = $self->_get_triggers();
}
=head2 _functions
This function is used to retrieve all functions information.
Set the main hash $self->{functions}.
=cut
sub _functions
{
my ($self, $type) = @_;
print STDERR "Retrieving functions information...\n" if ($self->{debug});
$self->{functions} = $self->_get_functions($type);
}
=head2 _tables =head2 _tables
This function is used to retrieve all table information. This function is used to retrieve all table information.
@ -288,10 +417,10 @@ main hash of the database structure :
It also call these other private subroutine to affect the main hash It also call these other private subroutine to affect the main hash
of the database structure : of the database structure :
@{$self->{tables}{$class_name}{column_info}} = &_column_info($self, $class_name); @{$self->{tables}{$class_name}{column_info}} = $self->_column_info($class_name);
@{$self->{tables}{$class_name}{primary_key}} = &_primary_key($self, $class_name); @{$self->{tables}{$class_name}{primary_key}} = $self->_primary_key($class_name);
@{$self->{tables}{$class_name}{unique_key}} = &_unique_key($self, $class_name); @{$self->{tables}{$class_name}{unique_key}} = $self->_unique_key($class_name);
@{$self->{tables}{$class_name}{foreign_key}} = &_foreign_key($self, $class_name); @{$self->{tables}{$class_name}{foreign_key}} = $self->_foreign_key($class_name);
=cut =cut
@ -301,7 +430,8 @@ sub _tables
# Get all tables information given by the DBI method table_info # Get all tables information given by the DBI method table_info
print STDERR "Retrieving table information...\n" if ($self->{debug}); print STDERR "Retrieving table information...\n" if ($self->{debug});
my $sth = $self->{dbh}->table_info or die $self->{dbh}->errstr;
my $sth = $self->_table_info or die $self->{dbh}->errstr;
my @tables_infos = $sth->fetchall_arrayref(); my @tables_infos = $sth->fetchall_arrayref();
if ($self->{showtableid}) { if ($self->{showtableid}) {
@ -312,7 +442,7 @@ print STDERR "Retrieving table information...\n" if ($self->{debug});
} }
return; return;
} }
my @done = ();
foreach my $table (@tables_infos) { foreach my $table (@tables_infos) {
# Set the table information for each class found # Set the table information for each class found
my $i = 1; my $i = 1;
@ -320,7 +450,11 @@ print STDERR "Min table dump set to $self->{min}.\n" if ($self->{debug} && $self
print STDERR "Max table dump set to $self->{max}.\n" if ($self->{debug} && $self->{max}); print STDERR "Max table dump set to $self->{max}.\n" if ($self->{debug} && $self->{max});
foreach my $t (@$table) { foreach my $t (@$table) {
# Jump to desired extraction # Jump to desired extraction
next if (${@$t}[2] =~ /\$/); if (grep(/^${@$t}[2]$/, @done)) {
print STDERR "SSSSSS duplicate ${@$t}[0] - ${@$t}[1] - ${@$t}[2]\n";
} else {
push(@done, ${@$t}[2]);
}
$i++, next if ($self->{min} && ($i < $self->{min})); $i++, next if ($self->{min} && ($i < $self->{min}));
last if ($self->{max} && ($i > $self->{max})); last if ($self->{max} && ($i > $self->{max}));
next if (($#{$self->{limited}} >= 0) && !grep(/^${@$t}[2]$/, @{$self->{limited}})); next if (($#{$self->{limited}} >= 0) && !grep(/^${@$t}[2]$/, @{$self->{limited}}));
@ -349,19 +483,15 @@ print STDERR "Scanning ${@$t}[2] (@$t)...\n" if ($self->{debug});
$self->{tables}{${@$t}[2]}{field_name} = $sth->{NAME}; $self->{tables}{${@$t}[2]}{field_name} = $sth->{NAME};
$self->{tables}{${@$t}[2]}{field_type} = $sth->{TYPE}; $self->{tables}{${@$t}[2]}{field_type} = $sth->{TYPE};
@{$self->{tables}{${@$t}[2]}{column_info}} = &_column_info($self, ${@$t}[2]); @{$self->{tables}{${@$t}[2]}{column_info}} = $self->_column_info(${@$t}[2]);
@{$self->{tables}{${@$t}[2]}{primary_key}} = &_primary_key($self, ${@$t}[2]); @{$self->{tables}{${@$t}[2]}{primary_key}} = $self->_primary_key(${@$t}[2]);
@{$self->{tables}{${@$t}[2]}{unique_key}} = &_unique_key($self, ${@$t}[2]); @{$self->{tables}{${@$t}[2]}{unique_key}} = $self->_unique_key(${@$t}[2]);
@{$self->{tables}{${@$t}[2]}{foreign_key}} = &_foreign_key($self, ${@$t}[2]); ($self->{tables}{${@$t}[2]}{foreign_link}, $self->{tables}{${@$t}[2]}{foreign_key}) = $self->_foreign_key(${@$t}[2]);
($self->{tables}{${@$t}[2]}{uniqueness}, $self->{tables}{${@$t}[2]}{indexes}) = &_get_indexes($self, ${@$t}[2]); ($self->{tables}{${@$t}[2]}{uniqueness}, $self->{tables}{${@$t}[2]}{indexes}) = $self->_get_indexes(${@$t}[2]);
$self->{tables}{${@$t}[2]}{grants} = &_get_table_privilege($self, ${@$t}[2]);
$i++; $i++;
} }
} }
print STDERR "Retrieving groups/users information...\n" if ($self->{debug});
$self->{groups} = &_get_roles($self);
} }
@ -377,8 +507,6 @@ It then set the main hash as follow:
# Definition of the view # Definition of the view
$self->{views}{$table}{text} = $view_infos{$table}; $self->{views}{$table}{text} = $view_infos{$table};
# Grants defined on the views
$self->{views}{$table}{grants} = when I find how...
=cut =cut
@ -388,7 +516,7 @@ sub _views
# Get all views information # Get all views information
print STDERR "Retrieving views information...\n" if ($self->{debug}); print STDERR "Retrieving views information...\n" if ($self->{debug});
my %view_infos = &_get_views($self); my %view_infos = $self->_get_views();
if ($self->{showtableid}) { if ($self->{showtableid}) {
my $i = 1; my $i = 1;
@ -433,25 +561,180 @@ sub _get_sql_data
$sql_header .= "--\n"; $sql_header .= "--\n";
$sql_header .= "-- This program is free software; you can redistribute it and/or modify it under\n"; $sql_header .= "-- This program is free software; you can redistribute it and/or modify it under\n";
$sql_header .= "-- the same terms as Perl itself.\n\n"; $sql_header .= "-- the same terms as Perl itself.\n\n";
$sql_header .= "BEGIN TRANSACTION;\n\n";
my $sql_output = ""; my $sql_output = "";
# Process view only # Process view only
if (exists $self->{views}) { if ($self->{type} eq 'VIEW') {
print STDERR "Add views definition...\n" if ($self->{debug});
foreach my $view (sort keys %{$self->{views}}) { foreach my $view (sort keys %{$self->{views}}) {
$sql_output .= "CREATE VIEW $view AS $self->{views}{$view}{text};\n"; $sql_output .= "CREATE VIEW \"\L$view\E\" AS $self->{views}{$view}{text};\n";
} }
if (!$sql_output) {
$sql_output = "-- Nothing found of type $self->{type}\n";
} else {
$sql_output .= "\n"; $sql_output .= "\n";
return $sql_header . $sql_output;
} }
my @groups = (); return $sql_header . $sql_output . "\nEND TRANSACTION";
}
# Process grant only
if ($self->{type} eq 'GRANT') {
print STDERR "Add groups/users privileges...\n" if ($self->{debug});
# Add groups definition
my $groups = '';
my @users = (); my @users = ();
# Dump the database structure as an XML Schema defintion my @grps = ();
foreach (@{$self->{users}}) {
next if (exists $self->{groups}{"$_"});
next if ($self->{schema} && ($_ ne $self->{schema}));
$sql_header .= "CREATE USER $_ WITH PASSWORD 'secret';\n";
}
foreach my $role (sort keys %{$self->{groups}}) {
push(@grps, $role);
$groups .= "CREATE GROUP $role WITH USER " . join(',', @{$self->{groups}{$role}}) . ";\n";
}
$sql_header .= "\n" . $groups . "\n";
# Add privilege definition
my $grants = '';
foreach my $table (sort keys %{$self->{grants}}) {
$grants .= "REVOKE ALL ON $table FROM PUBLIC;\n";
foreach my $priv (sort keys %{$self->{grants}{$table}}) {
my $usr = '';
my $grp = '';
foreach my $user (@{$self->{grants}{$table}{$priv}}) {
if (grep(/^$user$/, @grps)) {
$grp .= "$user,";
} else {
$usr .= "$user,";
}
}
$grp =~ s/,$//;
$usr =~ s/,$//;
if ($grp) {
$grants .= "GRANT $priv ON $table TO GROUP $grp;\n";
} else {
$grants .= "GRANT $priv ON $table TO $usr;\n";
}
}
}
if (!$grants) {
$$grants = "-- Nothing found of type $self->{type}\n";
}
$sql_output .= "\n" . $grants . "\n";
return $sql_header . $sql_output . "\nEND TRANSACTION";
}
# Process sequences only
if ($self->{type} eq 'SEQUENCE') {
print STDERR "Add sequences definition...\n" if ($self->{debug});
foreach my $seq (@{$self->{sequences}}) {
my $cache = 1;
$cache = $seq->[5] if ($seq->[5]);
my $cycle = '';
$cycle = ' CYCLE' if ($seq->[6] eq 'Y');
if ($seq->[2] > 2147483646) {
$seq->[2] = 2147483646;
}
if ($seq->[1] < -2147483647) {
$seq->[1] = -2147483647;
}
$sql_output .= "CREATE SEQUENCE \L$seq->[0]\E INCREMENT $seq->[3] MINVALUE $seq->[1] MAXVALUE $seq->[2] START $seq->[4] CACHE $cache$cycle;\n";
}
if (!$sql_output) {
$sql_output = "-- Nothing found of type $self->{type}\n";
}
return $sql_header . $sql_output . "\nEND TRANSACTION";
}
# Process triggers only. PL/SQL code is pre-converted to PL/PGSQL following
# the recommendation of Roberto Mello, see http://techdocs.postgresql.org/
# Oracle's PL/SQL to PostgreSQL PL/pgSQL HOWTO
if ($self->{type} eq 'TRIGGER') {
print STDERR "Add triggers definition...\n" if ($self->{debug});
foreach my $trig (@{$self->{triggers}}) {
$trig->[1] =~ s/ EACH ROW//;
chop($trig->[4]);
chomp($trig->[4]);
# Check if it's a pg rule
if ($trig->[1] =~ /INSTEAD OF/) {
$sql_output .= "CREATE RULE \L$trig->[0]\E AS\n\tON \L$trig->[3]\E\n\tDO INSTEAD\n(\n\t$trig->[4]\n);\n\n";
} else {
#--------------------------------------------
# PL/SQL to PL/PGSQL code conversion
#--------------------------------------------
# Change NVL to COALESCE
#$trig->[4] =~ s/NVL\(/coalesce(/igs;
# Change trunc() to date_trunc('day', field)
# Trunc is replaced with date_trunc if we find date in the name of the value
# because Oracle have the same trunc function on number and date type :-(((
#$trig->[4] =~ s/trunc\(([^\)]*date[^\)]*)\)/date_trunc('day', $1)/igs;
# Change SYSDATE to 'now'
#$trig->[4] =~ s/SYSDATE/CURRENT_TIMESTAMP/igs;
# Change nextval on sequence
# Oracle's sequence grammar is sequence_name.nextval.
# Postgres's sequence grammar is nextval('sequence_name').
#$trig->[4] =~ s/(\w+)\.nextval/nextval('$1')/isg;
# Escaping Single Quotes
#$trig->[4] =~ s/'/''/sg;
$sql_output .= "CREATE FUNCTION pg_fct_\L$trig->[0]\E () RETURNS OPAQUE AS '\n$trig->[4]\n' LANGUAGE 'plpgsql'\n\n";
$sql_output .= "CREATE TRIGGER \L$trig->[0]\E\n\t$trig->[1] $trig->[2] ON \L$trig->[3]\E FOR EACH ROW\n\tEXECUTE PROCEDURE pg_fct_\L$trig->[0]\E();\n\n";
}
}
if (!$sql_output) {
$sql_output = "-- Nothing found of type $self->{type}\n";
}
return $sql_header . $sql_output . "\nEND TRANSACTION";
}
# Process functions only
if (($self->{type} eq 'FUNCTION') || ($self->{type} eq 'PROCEDURE')) {
print STDERR "Add functions definition...\n" if ($self->{debug});
foreach my $fct (sort keys %{$self->{functions}}) {
my @tmp = ();
if ($self->{functions}{$fct} =~ /^[\s\t]*function/is) {
#$self->{functions}{$fct} =~ /function[\s\n\t]*$fct[\s\n\t]*\(([^\)]*)\)/is;
$self->{functions}{$fct} =~ /function[\s\n\t]*$fct[\s\n\t]*\(([^\)]*)\)[\s\n\t]*is/is;
@tmp = split(/\n/, $1);
} else {
#$self->{functions}{$fct} =~ /procedure[\s\n\t]*$fct[\s\n\t]*\(([^\)]*)\)/is;
$self->{functions}{$fct} =~ /procedure[\s\n\t]*$fct[\s\n\t]*\(([^\)]*)\)[\s\n\t]*is\W/is;
@tmp = split(/\n/, $1);
}
my @argu = split(/,/, join(' ', @tmp));
map { s/^.* in //is } @argu;
map { s/^.* out //is } @argu;
map { $_ = $self->_sql_type(uc($_)) } @argu;
$self->{functions}{$fct} =~ /return ([^\s]*) is/is;
$self->{functions}{$fct} = "-- Oracle function declaration, please edit to match PostgreSQL syntax.\n$self->{functions}{$fct}";
$sql_output .= "-- PostgreSQL possible function declaration, please edit to match your needs.\nCREATE FUNCTION \L$fct\E(" . join(',', @argu) . ") RETURNS " . $self->_sql_type(uc($1)) . " AS '\n$self->{functions}{$fct}\n' LANGUAGE 'sql'\n\n";
}
if (!$sql_output) {
$sql_output = "-- Nothing found of type $self->{type}\n";
}
return $sql_header . $sql_output . "\nEND TRANSACTION";
}
# Dump the database structure
foreach my $table (keys %{$self->{tables}}) { foreach my $table (keys %{$self->{tables}}) {
print STDERR "Dumping table $table...\n" if ($self->{debug}); print STDERR "Dumping table $table...\n" if ($self->{debug});
# Can be: TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY,
$sql_output .= "CREATE ${$self->{tables}{$table}{table_info}}[1] \"\L$table\E\" (\n"; $sql_output .= "CREATE ${$self->{tables}{$table}{table_info}}[1] \"\L$table\E\" (\n";
my $sql_ukey = ""; my $sql_ukey = "";
my $sql_pkey = ""; my $sql_pkey = "";
@ -460,11 +743,11 @@ print STDERR "Dumping table $table...\n" if ($self->{debug});
next if (${$f}[0] ne "${$self->{tables}{$table}{field_name}}[$i]"); next if (${$f}[0] ne "${$self->{tables}{$table}{field_name}}[$i]");
my $type = $self->_sql_type(${$f}[1], ${$f}[2]); my $type = $self->_sql_type(${$f}[1], ${$f}[2]);
$type = "${$f}[1], ${$f}[2]" if (!$type); $type = "${$f}[1], ${$f}[2]" if (!$type);
$sql_output .= "\t${$f}[0] $type"; $sql_output .= "\t\"\L${$f}[0]\E\" $type";
# Set the primary key definition # Set the primary key definition
foreach my $k (@{$self->{tables}{$table}{primary_key}}) { foreach my $k (@{$self->{tables}{$table}{primary_key}}) {
next if ($k ne "${$f}[0]"); next if ($k ne "${$f}[0]");
$sql_pkey .= "$k,"; $sql_pkey .= "\"\L$k\E\",";
last; last;
} }
if (${$f}[4] ne "") { if (${$f}[4] ne "") {
@ -475,7 +758,7 @@ print STDERR "Dumping table $table...\n" if ($self->{debug});
# Set the unique key definition # Set the unique key definition
foreach my $k (@{$self->{tables}{$table}{unique_key}}) { foreach my $k (@{$self->{tables}{$table}{unique_key}}) {
next if ( ($k ne "${$f}[0]") || (grep(/^$k$/, @{$self->{tables}{$table}{primary_key}})) ); next if ( ($k ne "${$f}[0]") || (grep(/^$k$/, @{$self->{tables}{$table}{primary_key}})) );
$sql_ukey .= "$k,"; $sql_ukey .= "\"\L$k\E\",";
last; last;
} }
$sql_output .= ",\n"; $sql_output .= ",\n";
@ -488,58 +771,39 @@ print STDERR "Dumping table $table...\n" if ($self->{debug});
$sql_output .= "\tPRIMARY KEY ($sql_pkey),\n" if ($sql_pkey); $sql_output .= "\tPRIMARY KEY ($sql_pkey),\n" if ($sql_pkey);
# Add constraint definition # Add constraint definition
my @done = ();
foreach my $h (@{$self->{tables}{$table}{foreign_key}}) { foreach my $h (@{$self->{tables}{$table}{foreign_key}}) {
foreach my $link (keys %{$h}) { next if (grep(/^$h->[0]$/, @done));
my ($reftable,$desttable) = split(/->/, $link); my $desttable = '';
next if ($reftable ne $table); foreach (keys %{$self->{tables}{$table}{foreign_link}{$h->[0]}{remote}}) {
my $localcols = ''; $desttable .= "$_";
foreach my $i (0 .. $#{${$h}{$link}{local}}) {
my $destname = "$desttable";
my $remote = "${${$h}{$link}{remote}}[$i]";
my $local = "${${$h}{$link}{local}}[$i]";
$sql_output .= "\tCONSTRAINT ${i}_\L$table\E_fk FOREIGN KEY ($local) REFERENCES $desttable ($remote),\n";
}
} }
push(@done, $h->[0]);
$sql_output .= "\tCONSTRAINT \L$h->[0]\E FOREIGN KEY (" . lc(join(',', @{$self->{tables}{$table}{foreign_link}{$h->[0]}{local}})) . ") REFERENCES \L$desttable\E (" . lc(join(',', @{$self->{tables}{$table}{foreign_link}{$h->[0]}{remote}{$desttable}})) . ")";
$sql_output .= " MATCH $h->[2]" if ($h->[2]);
$sql_output .= " ON DELETE $h->[3]";
$sql_output .= " $h->[4]";
$sql_output .= " INITIALLY $h->[5],\n";
} }
$sql_output =~ s/,$//; $sql_output =~ s/,$//;
$sql_output .= ");\n"; $sql_output .= ");\n";
foreach my $idx (keys %{$self->{tables}{$table}{indexes}}) { foreach my $idx (keys %{$self->{tables}{$table}{indexes}}) {
map { s/^/"/ } @{$self->{tables}{$table}{indexes}{$idx}};
map { s/$/"/ } @{$self->{tables}{$table}{indexes}{$idx}};
my $columns = join(',', @{$self->{tables}{$table}{indexes}{$idx}}); my $columns = join(',', @{$self->{tables}{$table}{indexes}{$idx}});
my $unique = ''; my $unique = '';
$unique = ' UNIQUE' if ($self->{tables}{$table}{uniqueness}{$idx} eq 'UNIQUE'); $unique = ' UNIQUE' if ($self->{tables}{$table}{uniqueness}{$idx} eq 'UNIQUE');
$sql_output .= "CREATE$unique INDEX \L$idx\E ON \L$table\E (\L$columns\E);\n"; $sql_output .= "CREATE$unique INDEX \"\L$idx\E\" ON \"\L$table\E\" (\L$columns\E);\n";
}
# Add grant on this table
$sql_output .= "REVOKE ALL ON $table FROM PUBLIC;\n";
foreach my $grp (keys %{$self->{tables}{$table}{grants}}) {
if (exists $self->{groups}{$grp}) {
$sql_output .= "GRANT " . join(',', @{$self->{tables}{$table}{grants}{$grp}}) . " ON $table TO GROUP $grp;\n";
push(@groups, $grp) if (!grep(/^$grp$/, @groups));
} else {
$sql_output .= "GRANT " . join(',', @{$self->{tables}{$table}{grants}{$grp}}) . " ON $table TO $grp;\n";
push(@users, $grp) if (!grep(/^$grp$/, @users));
}
} }
$sql_output .= "\n"; $sql_output .= "\n";
} }
# Add privilege definition if (!$sql_output) {
print STDERR "Add groups/users privileges...\n" if ($self->{debug} && exists $self->{groups}); $sql_output = "-- Nothing found of type TABLE\n";
my $grants = '';
foreach my $role (@groups) {
next if (!exists $self->{groups}{$role});
$grants .= "CREATE GROUP $role;\n";
$grants .= "ALTER GROUP $role ADD USERS " . join(',', @{$self->{groups}{$role}}) . ";\n";
foreach my $u (@{$self->{groups}{$role}}) {
push(@users, $u) if (!grep(/^$u$/, @users));
} }
}
foreach my $u (@users) {
$sql_header .= "CREATE USER $u WITH PASSWORD 'secret';\n";
}
$sql_header .= "\n" . $grants . "\n";
return $sql_header . $sql_output; return $sql_header . $sql_output . "\nEND TRANSACTION";
} }
@ -555,12 +819,12 @@ sub _sql_type
my ($self, $type, $len) = @_; my ($self, $type, $len) = @_;
my %TYPE = ( my %TYPE = (
'NUMBER' => 'double', 'NUMBER' => 'float8',
'LONG' => 'integer', 'LONG' => 'integer',
'CHAR' => 'char', 'CHAR' => 'char',
'VARCHAR2' => 'varchar', 'VARCHAR2' => 'varchar',
'DATE' => 'datetime', 'DATE' => 'datetime',
'RAW' => 'binary', 'RAW' => 'text',
'ROWID' => 'oid', 'ROWID' => 'oid',
'LONG RAW' => 'binary', 'LONG RAW' => 'binary',
); );
@ -575,7 +839,7 @@ sub _sql_type
} elsif (($type eq "CHAR") || ($type =~ /VARCHAR/)) { } elsif (($type eq "CHAR") || ($type =~ /VARCHAR/)) {
return "$TYPE{$type}($len)"; return "$TYPE{$type}($len)";
} else { } else {
return "$TYPE{$type}($len)"; return "$TYPE{$type}";
} }
} else { } else {
return $TYPE{$type}; return $TYPE{$type};
@ -717,68 +981,79 @@ sub _foreign_key
{ {
my ($self, $table) = @_; my ($self, $table) = @_;
my $sth = $self->{dbh}->prepare(<<END) or die $self->{dbh}->errstr; my $str = "SELECT CONSTRAINT_NAME,R_CONSTRAINT_NAME,SEARCH_CONDITION,DELETE_RULE,DEFERRABLE,DEFERRED FROM DBA_CONSTRAINTS WHERE CONSTRAINT_TYPE='R' AND STATUS='ENABLED' AND TABLE_NAME='$table'";
select cls.TABLE_NAME, clf.TABLE_NAME, cls.COLUMN_NAME, clf.COLUMN_NAME my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
from all_constraints cns, all_cons_columns clf , all_cons_columns cls
where cns.CONSTRAINT_TYPE='R'
and cns.constraint_name=cls.constraint_name
and clf.CONSTRAINT_NAME = cns.R_CONSTRAINT_NAME
and clf.OWNER = cns.OWNER
and clf.POSITION = clf.POSITION
and cns.STATUS='ENABLED'
and cns.TABLE_NAME='EVT_DEST_PROFILE'
order by cns.CONSTRAINT_NAME, cls.position
END
$sth->execute or die $sth->errstr; $sth->execute or die $sth->errstr;
my @data = (); my @data = ();
my %link = (); my %link = ();
my @tab_done = ();
while (my $row = $sth->fetch) { while (my $row = $sth->fetch) {
my @trig_info = split(/\\000/, ${@$row}[0]); next if (grep(/^$row->[0]$/, @tab_done));
# The first field is the name of the constraint, we push(@data, [ @$row ]);
# remove it because we use a table to table notation. push(@tab_done, $row->[0]);
my $trig_name = ${@$row}[0] . "->" . ${@$row}[1]; my $sql = "SELECT DISTINCT COLUMN_NAME FROM DBA_CONS_COLUMNS WHERE CONSTRAINT_NAME='$row->[0]'";
push(@{$link{$trig_name}{local}}, ${@$row}[2]); my $sth2 = $self->{dbh}->prepare($sql) or die $self->{dbh}->errstr;
push(@{$link{$trig_name}{remote}}, ${@$row}[3]); $sth2->execute or die $sth2->errstr;
my @done = ();
while (my $r = $sth2->fetch) {
if (!grep(/^$r->[0]$/, @done)) {
push(@{$link{$row->[0]}{local}}, $r->[0]);
push(@done, $r->[0]);
}
}
$sql = "SELECT DISTINCT TABLE_NAME,COLUMN_NAME FROM DBA_CONS_COLUMNS WHERE CONSTRAINT_NAME='$row->[1]'";
$sth2 = $self->{dbh}->prepare($sql) or die $self->{dbh}->errstr;
$sth2->execute or die $sth2->errstr;
@done = ();
while (my $r = $sth2->fetch) {
if (!grep(/^$r->[1]$/, @done)) {
push(@{$link{$row->[0]}{remote}{$r->[0]}}, $r->[1]);
push(@done, $r->[1]);
}
}
} }
push(@data, \%link);
return @data; return \%link, \@data;
} }
=head2 _get_table_privilege TABLE =head2 _get_users
This function implements a Oracle-native table grants This function implements a Oracle-native users information.
information.
Return a hash of array of all users and their grants on the Return a hash of all users as an array.
given table.
=cut =cut
sub _get_table_privilege sub _get_users
{ {
my($self, $table) = @_; my($self) = @_;
my @pg_grants = ('DELETE','INSERT','SELECT','UPDATE'); # Retrieve all USERS defined in this database
my $str = "SELECT USERNAME FROM DBA_USERS";
# Retrieve all ROLES defined in this database if (!$self->{schema}) {
my $str = "SELECT GRANTEE, PRIVILEGE FROM DBA_TAB_PRIVS WHERE TABLE_NAME='$table' ORDER BY GRANTEE, PRIVILEGE"; $str .= " WHERE USERNAME <> 'SYS' AND USERNAME <> 'SYSTEM' AND USERNAME <> 'DBSNMP'";
} else {
$str .= " WHERE USERNAME = '$self->{schema}'";
}
$str .= " ORDER BY USERNAME";
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr; my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr; $sth->execute or die $sth->errstr;
my %data = (); my @users = ();
while (my $row = $sth->fetch) { while (my $row = $sth->fetch) {
push(@{$data{$row->[0]}}, $row->[1]) if (grep(/$row->[1]/, @pg_grants)); push(@users, $row->[0]);
} }
return \%data; return \@users;
} }
=head2 _get_roles =head2 _get_roles
This function implements a Oracle-native roles/users This function implements a Oracle-native roles
information. information.
Return a hash of all groups (roles) as an array of associated users. Return a hash of all groups (roles) as an array of associated users.
@ -790,43 +1065,68 @@ sub _get_roles
my($self) = @_; my($self) = @_;
# Retrieve all ROLES defined in this database # Retrieve all ROLES defined in this database
my $str = "SELECT ROLE FROM DBA_ROLES ORDER BY ROLE"; my $str = "SELECT GRANTED_ROLE,GRANTEE FROM DBA_ROLE_PRIVS WHERE GRANTEE NOT IN (select distinct role from dba_roles)";
if (!$self->{schema}) {
$str .= " AND GRANTEE <> 'SYS' AND GRANTEE <> 'SYSTEM' AND GRANTEE <> 'DBSNMP'";
} else {
$str .= " AND GRANTEE = '$self->{schema}'";
}
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr; my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr; $sth->execute or die $sth->errstr;
my @roles = (); my %roles = ();
while (my $row = $sth->fetch) { while (my $row = $sth->fetch) {
push(@roles, $row->[0]); push(@{$roles{"$row->[0]"}}, $row->[1]);
} }
# Get all users associated to these roles return \%roles;
my %groups = ();
foreach my $r (@roles) {
my $str = "SELECT GRANTEE FROM DBA_ROLE_PRIVS WHERE GRANTEE <> 'SYS' AND GRANTEE <> 'SYSTEM' AND GRANTED_ROLE='$r' AND GRANTEE IN (SELECT USERNAME FROM DBA_USERS)";
$sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr;
my @users = ();
while (my $row = $sth->fetch) {
push(@users, $row->[0]);
}
$groups{$r} = \@users if ($#users >= 0);
}
return \%groups;
} }
=head2 _get_all_grants
This function implements a Oracle-native user privilege
information.
Return a hash of all tables grants as an array of associated users.
=cut
sub _get_all_grants
{
my($self) = @_;
my @PG_GRANTS = ('DELETE', 'INSERT', 'SELECT', 'UPDATE');
# Retrieve all ROLES defined in this database
my $str = "SELECT table_name,privilege,grantee FROM DBA_TAB_PRIVS";
if ($self->{schema}) {
$str .= " WHERE GRANTEE = '$self->{schema}'";
} else {
$str .= " WHERE GRANTEE <> 'SYS' AND GRANTEE <> 'SYSTEM' AND GRANTEE <> 'DBSNMP'";
}
$str .= " ORDER BY TABLE_NAME";
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr;
my %grants = ();
while (my $row = $sth->fetch) {
push(@{$grants{"$row->[0]"}{"$row->[1]"}}, $row->[2]) if (grep(/$row->[1]/, @PG_GRANTS));
}
return \%grants;
}
=head2 _get_indexes TABLE =head2 _get_indexes TABLE
This function implements a Oracle-native indexes This function implements a Oracle-native indexes information.
information.
Return an array of all indexes name which are not primary keys Return hash of array containing all unique index and a hash of
for the given table. array of all indexes name which are not primary keys for the
given table.
Note: Indexes name must be created like this tablename_fieldname
else they will not be retrieved or if tablename false in the output
fieldname.
=cut =cut
@ -850,34 +1150,36 @@ sub _get_indexes
} }
=head2 _get_sequences TABLE =head2 _get_sequences
This function implements a Oracle-native sequence This function implements a Oracle-native sequences
information. information.
Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE, Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE,
INCREMENT and LAST_NUMBER for the given table. INCREMENT and LAST_NUMBER for the given table.
Not working yet.
=cut =cut
sub _get_sequences sub _get_sequences
{ {
my($self, $table) = @_; my($self) = @_;
# Retrieve all indexes # Retrieve all indexes
my $str = "SELECT SEQUENCE_NAME, MIN_VALUE, MAX_VALUE, INCREMENT_BY, LAST_NUMBER FROM DBA_SEQUENCES WHERE SEQUENCE_OWNER <> 'SYS' AND SEQUENCE_OWNER <> 'SYSTEM'"; my $str = "SELECT DISTINCT SEQUENCE_NAME, MIN_VALUE, MAX_VALUE, INCREMENT_BY, LAST_NUMBER, CACHE_SIZE, CYCLE_FLAG FROM DBA_SEQUENCES";
if (!$self->{schema}) {
$str .= " WHERE SEQUENCE_OWNER <> 'SYS' AND SEQUENCE_OWNER <> 'SYSTEM' AND SEQUENCE_OWNER <> 'DBSNMP'";
} else {
$str .= " WHERE SEQUENCE_OWNER = '$self->{schema}'";
}
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr; my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr; $sth->execute or die $sth->errstr;
my %data = (); my @seqs = ();
while (my $row = $sth->fetch) { while (my $row = $sth->fetch) {
# next if ($row->[0] !~ /${table}_/); push(@seqs, [ @$row ]);
# push(@data, $row->[0]);
} }
return %data; return \@seqs;
} }
@ -885,8 +1187,7 @@ sub _get_sequences
This function implements a Oracle-native views information. This function implements a Oracle-native views information.
Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE, Return a hash of view name with the SQL query it is based on.
INCREMENT and LAST_NUMBER for the given table.
=cut =cut
@ -895,7 +1196,12 @@ sub _get_views
my($self) = @_; my($self) = @_;
# Retrieve all views # Retrieve all views
my $str = "SELECT VIEW_NAME,TEXT FROM DBA_VIEWS WHERE OWNER <> 'SYS' AND OWNER <> 'SYSTEM'"; my $str = "SELECT VIEW_NAME,TEXT FROM DBA_VIEWS";
if (!$self->{schema}) {
$str .= " WHERE OWNER <> 'SYS' AND OWNER <> 'SYSTEM' AND OWNER <> 'DBSNMP'";
} else {
$str .= " WHERE OWNER = '$self->{schema}'";
}
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr; my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr; $sth->execute or die $sth->errstr;
@ -908,6 +1214,110 @@ sub _get_views
} }
=head2 _get_triggers
This function implements a Oracle-native triggers information.
Return an array of refarray of all triggers informations
=cut
sub _get_triggers
{
my($self) = @_;
# Retrieve all indexes
my $str = "SELECT TRIGGER_NAME, TRIGGER_TYPE, TRIGGERING_EVENT, TABLE_NAME, TRIGGER_BODY FROM DBA_TRIGGERS WHERE STATUS='ENABLED'";
if (!$self->{schema}) {
$str .= " AND OWNER <> 'SYS' AND OWNER <> 'SYSTEM' AND OWNER <> 'DBSNMP'";
} else {
$str .= " AND OWNER = '$self->{schema}'";
}
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr;
my @triggers = ();
while (my $row = $sth->fetch) {
push(@triggers, [ @$row ]);
}
return \@triggers;
}
=head2 _get_functions
This function implements a Oracle-native functions information.
Return a hash of all function name with their PLSQL code
=cut
sub _get_functions
{
my($self, $type) = @_;
# Retrieve all indexes
my $str = "SELECT DISTINCT OBJECT_NAME,OWNER FROM DBA_OBJECTS WHERE OBJECT_TYPE='$type' AND STATUS='VALID'";
if (!$self->{schema}) {
$str .= " AND OWNER <> 'SYS' AND OWNER <> 'SYSTEM' AND OWNER <> 'DBSNMP'";
} else {
$str .= " AND OWNER = '$self->{schema}'";
}
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr;
my %functions = ();
my @fct_done = ();
while (my $row = $sth->fetch) {
next if (grep(/^$row->[0]$/, @fct_done));
push(@fct_done, $row->[0]);
my $sql = "SELECT TEXT FROM DBA_SOURCE WHERE OWNER='$row->[1]' AND NAME='$row->[0]' ORDER BY LINE";
my $sth2 = $self->{dbh}->prepare($sql) or die $self->{dbh}->errstr;
$sth2->execute or die $sth2->errstr;
while (my $r = $sth2->fetch) {
$functions{"$row->[0]"} .= $r->[0];
}
}
return \%functions;
}
=head2 _table_info
This function retrieve all Oracle-native tables information.
Return a handle to a DB query statement
=cut
sub _table_info
{
my $self = shift;
my $sql = "SELECT
NULL TABLE_CAT,
at.OWNER TABLE_SCHEM,
at.TABLE_NAME,
tc.TABLE_TYPE,
tc.COMMENTS REMARKS
from ALL_TABLES at, ALL_TAB_COMMENTS tc
where at.OWNER = tc.OWNER
and at.TABLE_NAME = tc.TABLE_NAME
";
if ($self->{schema}) {
$sql .= " and at.OWNER='$self->{schema}'";
} else {
$sql .= "and at.OWNER <> 'SYS' and at.OWNER <> 'SYSTEM' and at.OWNER <> 'DBSNMP'";
}
$sql .= " order by tc.TABLE_TYPE, at.OWNER, at.TABLE_NAME";
my $sth = $self->{dbh}->prepare( $sql ) or return undef;
$sth->execute or return undef;
$sth;
}
1; 1;

284
contrib/oracle/README.ora2pg
View File

@ -35,7 +35,9 @@ SYNOPSIS
datasource => $dbsrc, # Database DBD datasource datasource => $dbsrc, # Database DBD datasource
user => $dbuser, # Database user user => $dbuser, # Database user
password => $dbpwd, # Database password password => $dbpwd, # Database password
tables => \@tables, # Tables to extract tables => \@tables,
or # Tables to extract
tables => [('tab1','tab2')],
debug => 1 # To show somethings when running debug => 1 # To show somethings when running
); );
@ -56,12 +58,17 @@ SYNOPSIS
datasource => $dbsrc, # Database DBD datasource datasource => $dbsrc, # Database DBD datasource
user => $dbuser, # Database user user => $dbuser, # Database user
password => $dbpwd, # Database password password => $dbpwd, # Database password
min => 10 # Begin extraction at indice 10 min => 10, # Begin extraction at indice 10
max => 20 # End extraction at indice 20 max => 20 # End extraction at indice 20
); );
To know at which indices table can be found during extraction use the To choose a particular schema just set the following option to
option: your schema name :
schema => 'APPS'
To know at which indices table can be found during extraction
use the option:
showtableid => 1 showtableid => 1
@ -69,43 +76,77 @@ SYNOPSIS
type => 'VIEW' type => 'VIEW'
To extract all grants set the option type as follow:
type => 'GRANT'
To extract all sequences set the option type as follow:
type => 'SEQUENCE'
To extract all triggers set the option type as follow:
type => 'TRIGGER'
To extract all functions set the option type as follow:
type => 'FUNCTION'
To extract all procedures set the option type as follow:
type => 'PROCEDURE'
Default is table schema extraction Default is table schema extraction
type => 'TABLE'
DESCRIPTION DESCRIPTION
Ora2Pg is a perl OO module used to export an Oracle database schema to a Ora2Pg is a perl OO module used to export an Oracle database
PostgreSQL compatible schema. schema to a PostgreSQL compatible schema.
It simply connect to your Oracle database, extract its structure and It simply connect to your Oracle database, extract its structure
generate a SQL script that you can load into your PostgreSQL database. and generate a SQL script that you can load into your PostgreSQL
database.
I'm not a Oracle DBA so I don't really know something about its internal I'm not a Oracle DBA so I don't really know something about its
structure so you may find some incorrect things. Please tell me what is internal structure so you may find some incorrect things. Please
wrong and what can be better. tell me what is wrong and what can be better.
It currently only dump the database schema, with primary, unique and It currently dump the database schema (tables, views, sequences,
foreign keys. I've tried to excluded internal system tables but perhaps indexes, grants), with primary, unique and foreign keys into
not enougt, please let me know. PostgreSQL syntax without editing the SQL code generated.
Functions, procedures and triggers PL/SQL code generated must be
reviewed to match the PostgreSQL syntax. Some usefull
recommandation on porting Oracle to PostgreSQL can be found at
http://techdocs.postgresql.org/ under the "Converting from other
Databases to PostgreSQL" Oracle part. I just notice one thing
more is that the trunc() function in Oracle is the same for
number or date so be carefull when porting to PostgreSQL to use
trunc() for number and date_trunc() for date.
ABSTRACT ABSTRACT
The goal of the Ora2Pg perl module is to cover all part needed to export The goal of the Ora2Pg perl module is to cover all part needed
an Oracle database to a PostgreSQL database without other thing that to export an Oracle database to a PostgreSQL database without
provide the connection parameters to the Oracle database. other thing that provide the connection parameters to the Oracle
database.
Features must include: Features must include:
- Database schema export, with unique, primary and foreign key. - Database schema export (tables, views, sequences, indexes),
with unique, primary and foreign key.
- Grants/privileges export by user and group. - Grants/privileges export by user and group.
- Indexes and unique indexes export. - Table selection (by name and max table) export.
- Table or view selection (by name and max table) export. - Predefined functions/triggers/procedures export.
- Predefined function/trigger export (todo)
- Data export (todo)
- Sql query converter (todo) - Sql query converter (todo)
- Data export (todo)
My knowledge regarding database is really poor especially for Oracle so My knowledge regarding database is really poor especially for
contribution is welcome. Oracle so contribution is welcome.
REQUIREMENT REQUIREMENT
You just need the DBI and DBD::Oracle perl module to be installed You just need the DBI and DBD::Oracle perl module to be
installed
PUBLIC METHODS PUBLIC METHODS
new HASH_OPTIONS new HASH_OPTIONS
@ -117,7 +158,8 @@ PUBLIC METHODS
- datasource : DBD datasource (required) - datasource : DBD datasource (required)
- user : DBD user (optional with public access) - user : DBD user (optional with public access)
- password : DBD password (optional with public access) - password : DBD password (optional with public access)
- type : Type of data to extract, can be TABLE (default) or VIEW - schema : Oracle internal schema to extract
- type : Type of data to extract, can be TABLE,VIEW,GRANT,SEQUENCE,TRIGGER,FUNCTION,PROCEDURE
- debug : Print the current state of the parsing - debug : Print the current state of the parsing
- tables : Extract only the given tables (arrayref) - tables : Extract only the given tables (arrayref)
- showtableid : Display only the table indice during extraction - showtableid : Display only the table indice during extraction
@ -129,153 +171,202 @@ PUBLIC METHODS
export_sql FILENAME export_sql FILENAME
Print SQL conversion output to a filename or to STDOUT if no file is Print SQL conversion output to a filename or to STDOUT if no
given. file is given.
PUBLIC METHODS PRIVATE METHODS
_init HASH_OPTIONS _init HASH_OPTIONS
Initialize a Ora2Pg object instance with a connexion to the Oracle Initialize a Ora2Pg object instance with a connexion to the
database. Oracle database.
_grants
This function is used to retrieve all privilege information.
It extract all Oracle's ROLES to convert them as Postgres groups
and search all users associated to these roles.
Set the main hash $self->{groups}. Set the main hash $self-
>{grantss}.
_sequences
This function is used to retrieve all sequences information.
Set the main hash $self->{sequences}.
_triggers
This function is used to retrieve all triggers information.
Set the main hash $self->{triggers}.
_functions
This function is used to retrieve all functions information.
Set the main hash $self->{functions}.
_tables _tables
This function is used to retrieve all table information. This function is used to retrieve all table information.
Set the main hash of the database structure $self->{tables}. Keys are Set the main hash of the database structure $self->{tables}.
the names of all tables retrieved from the current database. Each table Keys are the names of all tables retrieved from the current
information compose an array associated to the table_info key as array database. Each table information compose an array associated to
reference. In other way: the table_info key as array reference. In other way:
$self->{tables}{$class_name}{table_info} = [(OWNER,TYPE)]; $self->{tables}{$class_name}{table_info} = [(OWNER,TYPE)];
DBI TYPE can be TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY, LOCAL DBI TYPE can be TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY,
TEMPORARY, ALIAS, SYNONYM or a data source specific type identifier. LOCAL TEMPORARY, ALIAS, SYNONYM or a data source specific type
This only extract TABLE type. identifier. This only extract TABLE type.
It also get the following informations in the DBI object to affect the It also get the following informations in the DBI object to
main hash of the database structure : affect the main hash of the database structure :
$self->{tables}{$class_name}{field_name} = $sth->{NAME}; $self->{tables}{$class_name}{field_name} = $sth->{NAME};
$self->{tables}{$class_name}{field_type} = $sth->{TYPE}; $self->{tables}{$class_name}{field_type} = $sth->{TYPE};
It also call these other private subroutine to affect the main hash of It also call these other private subroutine to affect the main
the database structure : hash of the database structure :
@{$self->{tables}{$class_name}{column_info}} = &_column_info($self, $class_name); @{$self->{tables}{$class_name}{column_info}} = $self->_column_info($class_name);
@{$self->{tables}{$class_name}{primary_key}} = &_primary_key($self, $class_name); @{$self->{tables}{$class_name}{primary_key}} = $self->_primary_key($class_name);
@{$self->{tables}{$class_name}{unique_key}} = &_unique_key($self, $class_name); @{$self->{tables}{$class_name}{unique_key}} = $self->_unique_key($class_name);
@{$self->{tables}{$class_name}{foreign_key}} = &_foreign_key($self, $class_name); @{$self->{tables}{$class_name}{foreign_key}} = $self->_foreign_key($class_name);
_views _views
This function is used to retrieve all views information. This function is used to retrieve all views information.
Set the main hash of the views definition $self->{views}. Keys are the Set the main hash of the views definition $self->{views}. Keys
names of all views retrieved from the current database values are the are the names of all views retrieved from the current database
text definition of the views. values are the text definition of the views.
It then set the main hash as follow: It then set the main hash as follow:
# Definition of the view # Definition of the view
$self->{views}{$table}{text} = $view_infos{$table}; $self->{views}{$table}{text} = $view_infos{$table};
# Grants defined on the views
$self->{views}{$table}{grants} = when I find how...
_get_sql_data _get_sql_data
Returns a string containing the entire SQL Schema definition compatible Returns a string containing the entire SQL Schema definition
with PostgreSQL compatible with PostgreSQL
_sql_type INTERNAL_TYPE LENGTH _sql_type INTERNAL_TYPE LENGTH
This function return the PostgreSQL datatype corresponding to the Oracle This function return the PostgreSQL datatype corresponding to
internal type. the Oracle internal type.
_column_info TABLE _column_info TABLE
This function implements a Oracle-native column information. This function implements a Oracle-native column information.
Return a list of array reference containing the following informations Return a list of array reference containing the following
for each column the given a table informations for each column the given a table
[( column name, column type, column length, nullable column, default [( column name, column type, column length, nullable column,
value )] default value )]
_primary_key TABLE _primary_key TABLE
This function implements a Oracle-native primary key column information. This function implements a Oracle-native primary key column
information.
Return a list of all column name defined as primary key for the given Return a list of all column name defined as primary key for the
table. given table.
_unique_key TABLE _unique_key TABLE
This function implements a Oracle-native unique key column information. This function implements a Oracle-native unique key column
information.
Return a list of all column name defined as unique key for the given Return a list of all column name defined as unique key for the
table. given table.
_foreign_key TABLE _foreign_key TABLE
This function implements a Oracle-native foreign key reference This function implements a Oracle-native foreign key reference
information. information.
Return a list of hash of hash of array reference. Ouuf! Nothing very Return a list of hash of hash of array reference. Ouuf! Nothing
difficult. The first hash is composed of all foreign key name. The very difficult. The first hash is composed of all foreign key
second hash just have two key known as 'local' and remote' corresponding name. The second hash just have two key known as 'local' and
to the local table where the foreign key is defined and the remote table remote' corresponding to the local table where the foreign key
where the key refer. is defined and the remote table where the key refer.
The foreign key name is composed as follow: The foreign key name is composed as follow:
'local_table_name->remote_table_name' 'local_table_name->remote_table_name'
Foreign key data consist in two array representing at the same indice Foreign key data consist in two array representing at the same
the local field and the remote field where the first one refer to the indice the local field and the remote field where the first one
second. Just like this: refer to the second. Just like this:
@{$link{$fkey_name}{local}} = @local_columns; @{$link{$fkey_name}{local}} = @local_columns;
@{$link{$fkey_name}{remote}} = @remote_columns; @{$link{$fkey_name}{remote}} = @remote_columns;
_get_table_privilege TABLE _get_users
This function implements a Oracle-native table grants information. This function implements a Oracle-native users information.
Return a hash of array of all users and their grants on the given table. Return a hash of all users as an array.
_get_roles _get_roles
This function implements a Oracle-native roles/users information. This function implements a Oracle-native roles information.
Return a hash of all groups (roles) as an array of associated users. Return a hash of all groups (roles) as an array of associated
users.
_get_all_grants
This function implements a Oracle-native user privilege
information.
Return a hash of all tables grants as an array of associated
users.
_get_indexes TABLE _get_indexes TABLE
This function implements a Oracle-native indexes information. This function implements a Oracle-native indexes information.
Return an array of all indexes name which are not primary keys for the Return hash of array containing all unique index and a hash of
array of all indexes name which are not primary keys for the
given table. given table.
Note: Indexes name must be created like this tablename_fieldname else _get_sequences
they will not be retrieved or if tablename false in the output
fieldname.
_get_sequences TABLE This function implements a Oracle-native sequences information.
This function implements a Oracle-native sequence information. Return a hash of array of sequence name with MIN_VALUE,
MAX_VALUE, INCREMENT and LAST_NUMBER for the given table.
Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE,
INCREMENT and LAST_NUMBER for the given table.
Not working yet.
_get_views _get_views
This function implements a Oracle-native views information. This function implements a Oracle-native views information.
Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE, Return a hash of view name with the SQL query it is based on.
INCREMENT and LAST_NUMBER for the given table.
_get_triggers
This function implements a Oracle-native triggers information.
Return an array of refarray of all triggers informations
_get_functions
This function implements a Oracle-native functions information.
Return a hash of all function name with their PLSQL code
_table_info
This function retrieve all Oracle-native tables information.
Return a handle to a DB query statement
AUTHOR AUTHOR
Gilles Darold <gilles@darold.net> Gilles Darold <gilles@darold.net>
@ -283,14 +374,15 @@ AUTHOR
COPYRIGHT COPYRIGHT
Copyright (c) 2001 Gilles Darold - All rights reserved. Copyright (c) 2001 Gilles Darold - All rights reserved.
This program is free software; you can redistribute it and/or modify it This program is free software; you can redistribute it and/or
under the same terms as Perl itself. modify it under the same terms as Perl itself.
BUGS BUGS
This perl module is in the same state as my knowledge regarding This perl module is in the same state as my knowledge regarding
database, it can move and not be compatible with older version so I will database, it can move and not be compatible with older version
do my best to give you official support for Ora2Pg. Your volontee to so I will do my best to give you official support for Ora2Pg.
help construct it and your contribution are welcome. Your volontee to help construct it and your contribution are
welcome.
SEE ALSO SEE ALSO
the DBI manpage, the DBD::Oracle manpage the DBI manpage, the DBD::Oracle manpage

19
contrib/oracle/TODO
View File

@ -1,6 +1,13 @@
- Extract sequences on tables. Seem to be difficult, can't find the way to link Here are some more thing to do :
a sequence with one or more column. So problably just dump and edit manually
- More precision in type conversion based on length (I've no good DB to do that) - More precision in type conversion based on length
- Extract triggers and internal function. (I've no good DB to do that)
- Extract datas.
- SQL queries converter. This will be done as soon as possible
The following need your help :
- Extracting/converting datas.
- SQL queries converter.
- PL/SQL code converter.

713
contrib/oracle/ora2pg.html
View File

@ -1,324 +1,593 @@
<HTML> <HTML>
<HEAD> <HEAD>
<TITLE>Ora2Pg - Oracle to PostgreSQL database schema converter</TITLE> <TITLE>Ora2Pg - Oracle to PostgreSQL database schema converter</TITLE>
<LINK REV="made" HREF="mailto:darold@localhost.localdomain"> <LINK REV="made" HREF="mailto:root@porky.devel.redhat.com">
</HEAD> </HEAD>
<BODY> <BODY>
<A NAME="__index__"></A>
<!-- INDEX BEGIN --> <!-- INDEX BEGIN -->
<UL> <UL>
<LI><A HREF="#name">NAME</A></LI> <LI><A HREF="#NAME">NAME</A>
<LI><A HREF="#synopsis">SYNOPSIS</A></LI> <LI><A HREF="#SYNOPSIS">SYNOPSIS</A>
<LI><A HREF="#description">DESCRIPTION</A></LI> <LI><A HREF="#DESCRIPTION">DESCRIPTION</A>
<LI><A HREF="#abstract">ABSTRACT</A></LI> <LI><A HREF="#ABSTRACT">ABSTRACT</A>
<LI><A HREF="#requirement">REQUIREMENT</A></LI> <LI><A HREF="#REQUIREMENT">REQUIREMENT</A>
<LI><A HREF="#public methods">PUBLIC METHODS</A></LI> <LI><A HREF="#PUBLIC_METHODS">PUBLIC METHODS</A>
<UL> <UL>
<LI><A HREF="#new hash_options">new HASH_OPTIONS</A></LI> <LI><A HREF="#new_HASH_OPTIONS">new HASH_OPTIONS</A>
<LI><A HREF="#export_sql filename">export_sql FILENAME</A></LI> <LI><A HREF="#export_sql_FILENAME">export_sql FILENAME</A>
</UL> </UL>
<LI><A HREF="#public methods">PUBLIC METHODS</A></LI> <LI><A HREF="#PRIVATE_METHODS">PRIVATE METHODS</A>
<UL> <UL>
<LI><A HREF="#_init hash_options">_init HASH_OPTIONS</A></LI> <LI><A HREF="#_init_HASH_OPTIONS">_init HASH_OPTIONS</A>
<LI><A HREF="#_tables">_tables</A></LI> <LI><A HREF="#_grants">_grants</A>
<LI><A HREF="#_views">_views</A></LI> <LI><A HREF="#_sequences">_sequences</A>
<LI><A HREF="#_get_sql_data">_get_sql_data</A></LI> <LI><A HREF="#_triggers">_triggers</A>
<LI><A HREF="#_sql_type internal_type length">_sql_type INTERNAL_TYPE LENGTH</A></LI> <LI><A HREF="#_functions">_functions</A>
<LI><A HREF="#_column_info table">_column_info TABLE</A></LI> <LI><A HREF="#_tables">_tables</A>
<LI><A HREF="#_primary_key table">_primary_key TABLE</A></LI> <LI><A HREF="#_views">_views</A>
<LI><A HREF="#_unique_key table">_unique_key TABLE</A></LI> <LI><A HREF="#_get_sql_data">_get_sql_data</A>
<LI><A HREF="#_foreign_key table">_foreign_key TABLE</A></LI> <LI><A HREF="#_sql_type_INTERNAL_TYPE_LENGTH">_sql_type INTERNAL_TYPE LENGTH</A>
<LI><A HREF="#_get_table_privilege table">_get_table_privilege TABLE</A></LI> <LI><A HREF="#_column_info_TABLE">_column_info TABLE</A>
<LI><A HREF="#_get_roles">_get_roles</A></LI> <LI><A HREF="#_primary_key_TABLE">_primary_key TABLE</A>
<LI><A HREF="#_get_indexes table">_get_indexes TABLE</A></LI> <LI><A HREF="#_unique_key_TABLE">_unique_key TABLE</A>
<LI><A HREF="#_get_sequences table">_get_sequences TABLE</A></LI> <LI><A HREF="#_foreign_key_TABLE">_foreign_key TABLE</A>
<LI><A HREF="#_get_views">_get_views</A></LI> <LI><A HREF="#_get_users">_get_users</A>
<LI><A HREF="#_get_roles">_get_roles</A>
<LI><A HREF="#_get_all_grants">_get_all_grants</A>
<LI><A HREF="#_get_indexes_TABLE">_get_indexes TABLE</A>
<LI><A HREF="#_get_sequences">_get_sequences</A>
<LI><A HREF="#_get_views">_get_views</A>
<LI><A HREF="#_get_triggers">_get_triggers</A>
<LI><A HREF="#_get_functions">_get_functions</A>
<LI><A HREF="#_table_info">_table_info</A>
</UL> </UL>
<LI><A HREF="#author">AUTHOR</A></LI> <LI><A HREF="#AUTHOR">AUTHOR</A>
<LI><A HREF="#copyright">COPYRIGHT</A></LI> <LI><A HREF="#COPYRIGHT">COPYRIGHT</A>
<LI><A HREF="#bugs">BUGS</A></LI> <LI><A HREF="#BUGS">BUGS</A>
<LI><A HREF="#see also">SEE ALSO</A></LI> <LI><A HREF="#SEE_ALSO">SEE ALSO</A>
</UL> </UL>
<!-- INDEX END --> <!-- INDEX END -->
<HR> <HR>
<P> <P>
<H1><A NAME="name">NAME</A></H1> <H1><A NAME="NAME">NAME</A></H1>
<P>Ora2Pg - Oracle to PostgreSQL database schema converter</P> <P>
Ora2Pg - Oracle to PostgreSQL database schema converter
<P> <P>
<HR> <HR>
<H1><A NAME="synopsis">SYNOPSIS</A></H1> <H1><A NAME="SYNOPSIS">SYNOPSIS</A></H1>
<PRE> <P>
BEGIN { <PRE> BEGIN {
$ENV{ORACLE_HOME} = '/usr/local/oracle/oracle816'; $ENV{ORACLE_HOME} = '/usr/local/oracle/oracle816';
}</PRE> }
<PRE> </PRE>
use strict;</PRE> <P>
<PRE> <PRE> use strict;
use Ora2Pg;</PRE> </PRE>
<PRE> <P>
# Init the database connection <PRE> use Ora2Pg;
</PRE>
<P>
<PRE> # Init the database connection
my $dbsrc = 'dbi:Oracle:host=testdb.samse.fr;sid=TEST;port=1521'; my $dbsrc = 'dbi:Oracle:host=testdb.samse.fr;sid=TEST;port=1521';
my $dbuser = 'system'; my $dbuser = 'system';
my $dbpwd = 'manager';</PRE> my $dbpwd = 'manager';
<PRE> </PRE>
# Create an instance of the Ora2Pg perl module <P>
<PRE> # Create an instance of the Ora2Pg perl module
my $schema = new Ora2Pg ( my $schema = new Ora2Pg (
datasource =&gt; $dbsrc, # Database DBD datasource datasource =&gt; $dbsrc, # Database DBD datasource
user =&gt; $dbuser, # Database user user =&gt; $dbuser, # Database user
password =&gt; $dbpwd, # Database password password =&gt; $dbpwd, # Database password
);</PRE> );
<PRE> </PRE>
# Create the POSTGRESQL representation of all objects in the database <P>
$schema-&gt;export_schema(&quot;output.sql&quot;);</PRE> <PRE> # Create the POSTGRESQL representation of all objects in the database
<PRE> $schema-&gt;export_schema(&quot;output.sql&quot;);
exit(0);</PRE> </PRE>
<P>or if you only want to extract some tables:</P> <P>
<PRE> <PRE> exit(0);
# Create an instance of the Ora2Pg perl module </PRE>
<P>
or if you only want to extract some tables:
<P>
<PRE> # Create an instance of the Ora2Pg perl module
my @tables = ('tab1', 'tab2', 'tab3'); my @tables = ('tab1', 'tab2', 'tab3');
my $schema = new Ora2Pg ( my $schema = new Ora2Pg (
datasource =&gt; $dbsrc, # Database DBD datasource datasource =&gt; $dbsrc, # Database DBD datasource
user =&gt; $dbuser, # Database user user =&gt; $dbuser, # Database user
password =&gt; $dbpwd, # Database password password =&gt; $dbpwd, # Database password
tables =&gt; \@tables, # Tables to extract tables =&gt; \@tables,
or # Tables to extract
tables =&gt; [('tab1','tab2')],
debug =&gt; 1 # To show somethings when running debug =&gt; 1 # To show somethings when running
);</PRE> );
<P>or if you only want to extract the 10 first tables:</P> </PRE>
<PRE> <P>
# Create an instance of the Ora2Pg perl module or if you only want to extract the 10 first tables:
<P>
<PRE> # Create an instance of the Ora2Pg perl module
my $schema = new Ora2Pg ( my $schema = new Ora2Pg (
datasource =&gt; $dbsrc, # Database DBD datasource datasource =&gt; $dbsrc, # Database DBD datasource
user =&gt; $dbuser, # Database user user =&gt; $dbuser, # Database user
password =&gt; $dbpwd, # Database password password =&gt; $dbpwd, # Database password
max =&gt; 10 # 10 first tables to extract max =&gt; 10 # 10 first tables to extract
);</PRE> );
<P>or if you only want to extract tables 10 to 20:</P> </PRE>
<PRE> <P>
# Create an instance of the Ora2Pg perl module or if you only want to extract tables 10 to 20:
<P>
<PRE> # Create an instance of the Ora2Pg perl module
my $schema = new Ora2Pg ( my $schema = new Ora2Pg (
datasource =&gt; $dbsrc, # Database DBD datasource datasource =&gt; $dbsrc, # Database DBD datasource
user =&gt; $dbuser, # Database user user =&gt; $dbuser, # Database user
password =&gt; $dbpwd, # Database password password =&gt; $dbpwd, # Database password
min =&gt; 10 # Begin extraction at indice 10 min =&gt; 10, # Begin extraction at indice 10
max =&gt; 20 # End extraction at indice 20 max =&gt; 20 # End extraction at indice 20
);</PRE> );
<P>To know at which indices table can be found during extraction use the option:</P> </PRE>
<PRE> <P>
showtableid =&gt; 1</PRE> To choose a particular schema just set the following option to your schema
<P>To extract all views set the option type as follow:</P> name :
<PRE>
type =&gt; 'VIEW'</PRE> <P>
<P>Default is table schema extraction</P> <PRE> schema =&gt; 'APPS'
</PRE>
<P>
To know at which indices table can be found during extraction use the
option:
<P>
<PRE> showtableid =&gt; 1
</PRE>
<P>
To extract all views set the option type as follow:
<P>
<PRE> type =&gt; 'VIEW'
</PRE>
<P>
To extract all grants set the option type as follow:
<P>
<PRE> type =&gt; 'GRANT'
</PRE>
<P>
To extract all sequences set the option type as follow:
<P>
<PRE> type =&gt; 'SEQUENCE'
</PRE>
<P>
To extract all triggers set the option type as follow:
<P>
<PRE> type =&gt; 'TRIGGER'
</PRE>
<P>
To extract all functions set the option type as follow:
<P>
<PRE> type =&gt; 'FUNCTION'
</PRE>
<P>
To extract all procedures set the option type as follow:
<P>
<PRE> type =&gt; 'PROCEDURE'
</PRE>
<P>
Default is table schema extraction
<P>
<PRE> type =&gt; 'TABLE'
</PRE>
<P> <P>
<HR> <HR>
<H1><A NAME="description">DESCRIPTION</A></H1> <H1><A NAME="DESCRIPTION">DESCRIPTION</A></H1>
<P>Ora2Pg is a perl OO module used to export an Oracle database schema <P>
to a PostgreSQL compatible schema.</P> Ora2Pg is a perl OO module used to export an Oracle database schema to a
<P>It simply connect to your Oracle database, extract its structure and PostgreSQL compatible schema.
generate a SQL script that you can load into your PostgreSQL database.</P>
<P>I'm not a Oracle DBA so I don't really know something about its internal <P>
It simply connect to your Oracle database, extract its structure and
generate a SQL script that you can load into your PostgreSQL database.
<P>
I'm not a Oracle DBA so I don't really know something about its internal
structure so you may find some incorrect things. Please tell me what is structure so you may find some incorrect things. Please tell me what is
wrong and what can be better.</P> wrong and what can be better.
<P>It currently only dump the database schema, with primary, unique and
foreign keys. I've tried to excluded internal system tables but perhaps <P>
not enougt, please let me know.</P> It currently dump the database schema (tables, views, sequences, indexes,
grants), with primary, unique and foreign keys into PostgreSQL syntax
without editing the SQL code generated.
<P>
Functions, procedures and triggers PL/SQL code generated must be reviewed
to match the PostgreSQL syntax. Some usefull recommandation on porting
Oracle to PostgreSQL can be found at <A
HREF="http://techdocs.postgresql.org/">http://techdocs.postgresql.org/</A>
under the ``Converting from other Databases to PostgreSQL'' Oracle part. I
just notice one thing more is that the <CODE>trunc()</CODE> function in
Oracle is the same for number or date so be carefull when porting to
PostgreSQL to use <CODE>trunc()</CODE> for number and
<CODE>date_trunc()</CODE> for date.
<P> <P>
<HR> <HR>
<H1><A NAME="abstract">ABSTRACT</A></H1> <H1><A NAME="ABSTRACT">ABSTRACT</A></H1>
<P>The goal of the Ora2Pg perl module is to cover all part needed to export <P>
an Oracle database to a PostgreSQL database without other thing that provide The goal of the Ora2Pg perl module is to cover all part needed to export an
the connection parameters to the Oracle database.</P> Oracle database to a PostgreSQL database without other thing that provide
<P>Features must include:</P> the connection parameters to the Oracle database.
<PRE>
- Database schema export, with unique, primary and foreign key. <P>
Features must include:
<P>
<PRE> - Database schema export (tables, views, sequences, indexes),
with unique, primary and foreign key.
- Grants/privileges export by user and group. - Grants/privileges export by user and group.
- Indexes and unique indexes export. - Table selection (by name and max table) export.
- Table or view selection (by name and max table) export. - Predefined functions/triggers/procedures export.
- Predefined function/trigger export (todo) - Sql query converter (todo)
- Data export (todo) - Data export (todo)
- Sql query converter (todo)</PRE> </PRE>
<P>My knowledge regarding database is really poor especially for Oracle <P>
so contribution is welcome.</P> My knowledge regarding database is really poor especially for Oracle so
contribution is welcome.
<P> <P>
<HR> <HR>
<H1><A NAME="requirement">REQUIREMENT</A></H1> <H1><A NAME="REQUIREMENT">REQUIREMENT</A></H1>
<P>You just need the DBI and DBD::Oracle perl module to be installed</P> <P>
You just need the DBI and DBD::Oracle perl module to be installed
<P> <P>
<HR> <HR>
<H1><A NAME="public methods">PUBLIC METHODS</A></H1> <H1><A NAME="PUBLIC_METHODS">PUBLIC METHODS</A></H1>
<P> <P>
<H2><A NAME="new hash_options">new HASH_OPTIONS</A></H2> <HR>
<P>Creates a new Ora2Pg object.</P> <H2><A NAME="new_HASH_OPTIONS">new HASH_OPTIONS</A></H2>
<P>Supported options are:</P> <P>
<PRE> Creates a new Ora2Pg object.
- datasource : DBD datasource (required)
<P>
Supported options are:
<P>
<PRE> - datasource : DBD datasource (required)
- user : DBD user (optional with public access) - user : DBD user (optional with public access)
- password : DBD password (optional with public access) - password : DBD password (optional with public access)
- type : Type of data to extract, can be TABLE (default) or VIEW - schema : Oracle internal schema to extract
- type : Type of data to extract, can be TABLE,VIEW,GRANT,SEQUENCE,TRIGGER,FUNCTION,PROCEDURE
- debug : Print the current state of the parsing - debug : Print the current state of the parsing
- tables : Extract only the given tables (arrayref) - tables : Extract only the given tables (arrayref)
- showtableid : Display only the table indice during extraction - showtableid : Display only the table indice during extraction
- min : Indice to begin extraction. Default to 0 - min : Indice to begin extraction. Default to 0
- max : Indice to end extraction. Default to 0 mean no limits</PRE> - max : Indice to end extraction. Default to 0 mean no limits
<P>Attempt that this list should grow a little more because all initialization is </PRE>
done by this way.</P>
<P> <P>
<H2><A NAME="export_sql filename">export_sql FILENAME</A></H2> Attempt that this list should grow a little more because all initialization
<P>Print SQL conversion output to a filename or is done by this way.
to STDOUT if no file is given.</P>
<P> <P>
<HR> <HR>
<H1><A NAME="public methods">PUBLIC METHODS</A></H1> <H2><A NAME="export_sql_FILENAME">export_sql FILENAME</A></H2>
<P> <P>
<H2><A NAME="_init hash_options">_init HASH_OPTIONS</A></H2> Print SQL conversion output to a filename or to STDOUT if no file is given.
<P>Initialize a Ora2Pg object instance with a connexion to the
Oracle database.</P>
<P> <P>
<HR>
<H1><A NAME="PRIVATE_METHODS">PRIVATE METHODS</A></H1>
<P>
<HR>
<H2><A NAME="_init_HASH_OPTIONS">_init HASH_OPTIONS</A></H2>
<P>
Initialize a Ora2Pg object instance with a connexion to the Oracle
database.
<P>
<HR>
<H2><A NAME="_grants">_grants</A></H2>
<P>
This function is used to retrieve all privilege information.
<P>
It extract all Oracle's ROLES to convert them as Postgres groups and search
all users associated to these roles.
<P>
Set the main hash $self-&gt;{groups}. Set the main hash
$self-&gt;{grantss}.
<P>
<HR>
<H2><A NAME="_sequences">_sequences</A></H2>
<P>
This function is used to retrieve all sequences information.
<P>
Set the main hash $self-&gt;{sequences}.
<P>
<HR>
<H2><A NAME="_triggers">_triggers</A></H2>
<P>
This function is used to retrieve all triggers information.
<P>
Set the main hash $self-&gt;{triggers}.
<P>
<HR>
<H2><A NAME="_functions">_functions</A></H2>
<P>
This function is used to retrieve all functions information.
<P>
Set the main hash $self-&gt;{functions}.
<P>
<HR>
<H2><A NAME="_tables">_tables</A></H2> <H2><A NAME="_tables">_tables</A></H2>
<P>This function is used to retrieve all table information.</P>
<P>Set the main hash of the database structure $self-&gt;{tables}.
Keys are the names of all tables retrieved from the current
database. Each table information compose an array associated
to the table_info key as array reference. In other way:</P>
<PRE>
$self-&gt;{tables}{$class_name}{table_info} = [(OWNER,TYPE)];</PRE>
<P>DBI TYPE can be TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY, LOCAL TEMPORARY,
ALIAS, SYNONYM or a data source specific type identifier. This only extract
TABLE type.</P>
<P>It also get the following informations in the DBI object to affect the
main hash of the database structure :</P>
<PRE>
$self-&gt;{tables}{$class_name}{field_name} = $sth-&gt;{NAME};
$self-&gt;{tables}{$class_name}{field_type} = $sth-&gt;{TYPE};</PRE>
<P>It also call these other private subroutine to affect the main hash
of the database structure :</P>
<PRE>
@{$self-&gt;{tables}{$class_name}{column_info}} = &amp;_column_info($self, $class_name);
@{$self-&gt;{tables}{$class_name}{primary_key}} = &amp;_primary_key($self, $class_name);
@{$self-&gt;{tables}{$class_name}{unique_key}} = &amp;_unique_key($self, $class_name);
@{$self-&gt;{tables}{$class_name}{foreign_key}} = &amp;_foreign_key($self, $class_name);</PRE>
<P> <P>
This function is used to retrieve all table information.
<P>
Set the main hash of the database structure $self-&gt;{tables}. Keys are
the names of all tables retrieved from the current database. Each table
information compose an array associated to the table_info key as array
reference. In other way:
<P>
<PRE> $self-&gt;{tables}{$class_name}{table_info} = [(OWNER,TYPE)];
</PRE>
<P>
DBI TYPE can be TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY, LOCAL
TEMPORARY, ALIAS, SYNONYM or a data source specific type identifier. This
only extract TABLE type.
<P>
It also get the following informations in the DBI object to affect the main
hash of the database structure :
<P>
<PRE> $self-&gt;{tables}{$class_name}{field_name} = $sth-&gt;{NAME};
$self-&gt;{tables}{$class_name}{field_type} = $sth-&gt;{TYPE};
</PRE>
<P>
It also call these other private subroutine to affect the main hash of the
database structure :
<P>
<PRE> @{$self-&gt;{tables}{$class_name}{column_info}} = $self-&gt;_column_info($class_name);
@{$self-&gt;{tables}{$class_name}{primary_key}} = $self-&gt;_primary_key($class_name);
@{$self-&gt;{tables}{$class_name}{unique_key}} = $self-&gt;_unique_key($class_name);
@{$self-&gt;{tables}{$class_name}{foreign_key}} = $self-&gt;_foreign_key($class_name);
</PRE>
<P>
<HR>
<H2><A NAME="_views">_views</A></H2> <H2><A NAME="_views">_views</A></H2>
<P>This function is used to retrieve all views information.</P> <P>
<P>Set the main hash of the views definition $self-&gt;{views}. This function is used to retrieve all views information.
Keys are the names of all views retrieved from the current
database values are the text definition of the views.</P> <P>
<P>It then set the main hash as follow:</P> Set the main hash of the views definition $self-&gt;{views}. Keys are the
<PRE> names of all views retrieved from the current database values are the text
# Definition of the view definition of the views.
<P>
It then set the main hash as follow:
<P>
<PRE> # Definition of the view
$self-&gt;{views}{$table}{text} = $view_infos{$table}; $self-&gt;{views}{$table}{text} = $view_infos{$table};
# Grants defined on the views </PRE>
$self-&gt;{views}{$table}{grants} = when I find how...</PRE>
<P> <P>
<HR>
<H2><A NAME="_get_sql_data">_get_sql_data</A></H2> <H2><A NAME="_get_sql_data">_get_sql_data</A></H2>
<P>Returns a string containing the entire SQL Schema definition compatible with PostgreSQL</P>
<P> <P>
<H2><A NAME="_sql_type internal_type length">_sql_type INTERNAL_TYPE LENGTH</A></H2> Returns a string containing the entire SQL Schema definition compatible
<P>This function return the PostgreSQL datatype corresponding to the with PostgreSQL
Oracle internal type.</P>
<P> <P>
<H2><A NAME="_column_info table">_column_info TABLE</A></H2> <HR>
<P>This function implements a Oracle-native column information.</P> <H2><A NAME="_sql_type_INTERNAL_TYPE_LENGTH">_sql_type INTERNAL_TYPE LENGTH</A></H2>
<P>Return a list of array reference containing the following informations
for each column the given a table</P>
<P>[(
column name,
column type,
column length,
nullable column,
default value
)]</P>
<P> <P>
<H2><A NAME="_primary_key table">_primary_key TABLE</A></H2> This function return the PostgreSQL datatype corresponding to the Oracle
<P>This function implements a Oracle-native primary key column internal type.
information.</P>
<P>Return a list of all column name defined as primary key
for the given table.</P>
<P> <P>
<H2><A NAME="_unique_key table">_unique_key TABLE</A></H2> <HR>
<P>This function implements a Oracle-native unique key column <H2><A NAME="_column_info_TABLE">_column_info TABLE</A></H2>
information.</P>
<P>Return a list of all column name defined as unique key
for the given table.</P>
<P> <P>
<H2><A NAME="_foreign_key table">_foreign_key TABLE</A></H2> This function implements a Oracle-native column information.
<P>This function implements a Oracle-native foreign key reference
information.</P>
<P>Return a list of hash of hash of array reference. Ouuf! Nothing very difficult.
The first hash is composed of all foreign key name. The second hash just have
two key known as 'local' and remote' corresponding to the local table where the
foreign key is defined and the remote table where the key refer.</P>
<P>The foreign key name is composed as follow:</P>
<PRE>
'local_table_name-&gt;remote_table_name'</PRE>
<P>Foreign key data consist in two array representing at the same indice the local
field and the remote field where the first one refer to the second.
Just like this:</P>
<PRE>
@{$link{$fkey_name}{local}} = @local_columns;
@{$link{$fkey_name}{remote}} = @remote_columns;</PRE>
<P> <P>
<H2><A NAME="_get_table_privilege table">_get_table_privilege TABLE</A></H2> Return a list of array reference containing the following informations for
<P>This function implements a Oracle-native table grants each column the given a table
information.</P>
<P>Return a hash of array of all users and their grants on the
given table.</P>
<P> <P>
[( column name, column type, column length, nullable column, default value
)]
<P>
<HR>
<H2><A NAME="_primary_key_TABLE">_primary_key TABLE</A></H2>
<P>
This function implements a Oracle-native primary key column information.
<P>
Return a list of all column name defined as primary key for the given
table.
<P>
<HR>
<H2><A NAME="_unique_key_TABLE">_unique_key TABLE</A></H2>
<P>
This function implements a Oracle-native unique key column information.
<P>
Return a list of all column name defined as unique key for the given table.
<P>
<HR>
<H2><A NAME="_foreign_key_TABLE">_foreign_key TABLE</A></H2>
<P>
This function implements a Oracle-native foreign key reference information.
<P>
Return a list of hash of hash of array reference. Ouuf! Nothing very
difficult. The first hash is composed of all foreign key name. The second
hash just have two key known as 'local' and remote' corresponding to the
local table where the foreign key is defined and the remote table where the
key refer.
<P>
The foreign key name is composed as follow:
<P>
<PRE> 'local_table_name-&gt;remote_table_name'
</PRE>
<P>
Foreign key data consist in two array representing at the same indice the
local field and the remote field where the first one refer to the second.
Just like this:
<P>
<PRE> @{$link{$fkey_name}{local}} = @local_columns;
@{$link{$fkey_name}{remote}} = @remote_columns;
</PRE>
<P>
<HR>
<H2><A NAME="_get_users">_get_users</A></H2>
<P>
This function implements a Oracle-native users information.
<P>
Return a hash of all users as an array.
<P>
<HR>
<H2><A NAME="_get_roles">_get_roles</A></H2> <H2><A NAME="_get_roles">_get_roles</A></H2>
<P>This function implements a Oracle-native roles/users
information.</P>
<P>Return a hash of all groups (roles) as an array of associated users.</P>
<P> <P>
<H2><A NAME="_get_indexes table">_get_indexes TABLE</A></H2> This function implements a Oracle-native roles information.
<P>This function implements a Oracle-native indexes
information.</P>
<P>Return an array of all indexes name which are not primary keys
for the given table.</P>
<P>Note: Indexes name must be created like this tablename_fieldname
else they will not be retrieved or if tablename false in the output
fieldname.</P>
<P> <P>
<H2><A NAME="_get_sequences table">_get_sequences TABLE</A></H2> Return a hash of all groups (roles) as an array of associated users.
<P>This function implements a Oracle-native sequence
information.</P>
<P>Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE,
INCREMENT and LAST_NUMBER for the given table.</P>
<P>Not working yet.</P>
<P> <P>
<HR>
<H2><A NAME="_get_all_grants">_get_all_grants</A></H2>
<P>
This function implements a Oracle-native user privilege information.
<P>
Return a hash of all tables grants as an array of associated users.
<P>
<HR>
<H2><A NAME="_get_indexes_TABLE">_get_indexes TABLE</A></H2>
<P>
This function implements a Oracle-native indexes information.
<P>
Return hash of array containing all unique index and a hash of array of all
indexes name which are not primary keys for the given table.
<P>
<HR>
<H2><A NAME="_get_sequences">_get_sequences</A></H2>
<P>
This function implements a Oracle-native sequences information.
<P>
Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE,
INCREMENT and LAST_NUMBER for the given table.
<P>
<HR>
<H2><A NAME="_get_views">_get_views</A></H2> <H2><A NAME="_get_views">_get_views</A></H2>
<P>This function implements a Oracle-native views information.</P> <P>
<P>Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE, This function implements a Oracle-native views information.
INCREMENT and LAST_NUMBER for the given table.</P>
<P>
Return a hash of view name with the SQL query it is based on.
<P> <P>
<HR> <HR>
<H1><A NAME="author">AUTHOR</A></H1> <H2><A NAME="_get_triggers">_get_triggers</A></H2>
<P>Gilles Darold &lt;<A HREF="mailto:gilles@darold.net">gilles@darold.net</A>&gt;</P> <P>
This function implements a Oracle-native triggers information.
<P>
Return an array of refarray of all triggers informations
<P> <P>
<HR> <HR>
<H1><A NAME="copyright">COPYRIGHT</A></H1> <H2><A NAME="_get_functions">_get_functions</A></H2>
<P>Copyright (c) 2001 Gilles Darold - All rights reserved.</P> <P>
<P>This program is free software; you can redistribute it and/or modify it under This function implements a Oracle-native functions information.
the same terms as Perl itself.</P>
<P>
Return a hash of all function name with their PLSQL code
<P> <P>
<HR> <HR>
<H1><A NAME="bugs">BUGS</A></H1> <H2><A NAME="_table_info">_table_info</A></H2>
<P>This perl module is in the same state as my knowledge regarding database, <P>
This function retrieve all Oracle-native tables information.
<P>
Return a handle to a DB query statement
<P>
<HR>
<H1><A NAME="AUTHOR">AUTHOR</A></H1>
<P>
Gilles Darold &lt;<A
HREF="mailto:gilles@darold.net">gilles@darold.net</A>&gt;
<P>
<HR>
<H1><A NAME="COPYRIGHT">COPYRIGHT</A></H1>
<P>
Copyright (c) 2001 Gilles Darold - All rights reserved.
<P>
This program is free software; you can redistribute it and/or modify it
under the same terms as Perl itself.
<P>
<HR>
<H1><A NAME="BUGS">BUGS</A></H1>
<P>
This perl module is in the same state as my knowledge regarding database,
it can move and not be compatible with older version so I will do my best it can move and not be compatible with older version so I will do my best
to give you official support for Ora2Pg. Your volontee to help construct to give you official support for Ora2Pg. Your volontee to help construct it
it and your contribution are welcome.</P> and your contribution are welcome.
<P> <P>
<HR> <HR>
<H1><A NAME="see also">SEE ALSO</A></H1> <H1><A NAME="SEE_ALSO">SEE ALSO</A></H1>
<P><EM>DBI</EM>, <A HREF="/DBD/Oracle.html">the DBD::Oracle manpage</A></P> <P>
<EM>DBI</EM>, <A HREF="/DBD/Oracle.html">DBD::Oracle</A>
</BODY> </BODY>

17
contrib/oracle/ora2pg.pl
View File

@ -30,11 +30,22 @@ my $schema = new Ora2Pg (
user => $dbuser, # Database user user => $dbuser, # Database user
password => $dbpwd, # Database password password => $dbpwd, # Database password
debug => 1, # Verbose mode debug => 1, # Verbose mode
schema => 'APPS', # Extract only APPS schema
type => 'TABLE', # Extract table
# type => 'VIEW', # Extract views # type => 'VIEW', # Extract views
# tables => [('MY_TABLE1','MY_TABLE2')], # Extract only these table # type => 'GRANT', # Extract privileges
# type => 'SEQUENCE', # Extract sequences
# type => 'TRIGGER', # Extract triggers
# type => 'FUNCTION', # Extract functions
# type => 'PROCEDURE', # Extract procedures
# tables => [('FND_USER_PREFERENCES')], # unique index + users
# tables => [('CUSTOMER_DATA')], # Unique and primary key
# tables => [('TX_DATA')], # simple indexes
# tables => [('NDW_BROWSER_ATTRIBUTES')], # view
# tables => [('TRIP_DATA')], # Foreign key
# showtableid => 1, # Display only table indice during extraction # showtableid => 1, # Display only table indice during extraction
# min => 1, # Extract begin at indice 1 # min => 1, # Extract begin at indice 3
# max => 10 # Extract ended at indice 10 # max => 10 # Extract ended at indice 5
); );
# Create the POSTGRESQL representation of all objects in the database # Create the POSTGRESQL representation of all objects in the database