migration-tools.git
2 days agoadding x_migrate flag and changing reference to text for defensive input munging master
Rogan Hamby [Tue, 16 Jul 2019 15:46:32 +0000]
adding x_migrate flag and changing reference to text for defensive input munging

2 days agoexpanding columns on map_tlc_holding_code
Rogan Hamby [Tue, 16 Jul 2019 15:38:52 +0000]
expanding columns on map_tlc_holding_code

3 days agomore logic checkinf for existing bre tables
Rogan Hamby [Mon, 15 Jul 2019 16:03:31 +0000]
more logic checkinf for existing bre tables

3 days agomake biblio_record_entry be biblio_record_entry_legacy
Rogan Hamby [Mon, 15 Jul 2019 15:55:07 +0000]
make biblio_record_entry be biblio_record_entry_legacy

10 days agoadded version of strip_tag to take string and subfield as arguments
Rogan Hamby [Mon, 8 Jul 2019 18:20:18 +0000]
added version of strip_tag to take string and subfield as arguments

3 weeks agoimprovement for migration_tools.is_circ_rule_safe_to_delete
Jason Etheridge [Mon, 24 Jun 2019 22:21:57 +0000]
improvement for migration_tools.is_circ_rule_safe_to_delete

Signed-off-by: Jason Etheridge <jason@EquinoxInitiative.org>

3 weeks agowait, you thought this was EG specific? :) migration_tools.generate_koha_holding_tag
Jason Etheridge [Mon, 24 Jun 2019 21:30:00 +0000]
wait, you thought this was EG specific? :)  migration_tools.generate_koha_holding_tag

Signed-off-by: Jason Etheridge <jason@EquinoxInitiative.org>

3 weeks agocombine 245ab for openbiblio2marc
Jason Etheridge [Sun, 23 Jun 2019 07:51:11 +0000]
combine 245ab for openbiblio2marc

3 weeks agomigration_tools.consolidate_tag
Jason Etheridge [Sun, 23 Jun 2019 07:48:57 +0000]
migration_tools.consolidate_tag

3 weeks agouse 001 instead of 999 for storing the old openbiblio bibid
Jason Etheridge [Sun, 23 Jun 2019 03:15:11 +0000]
use 001 instead of 999 for storing the old openbiblio bibid

Signed-off-by: Jason Etheridge <jason@EquinoxInitiative.org>

3 weeks agomigration_tools.openbiblio2marc
Jason Etheridge [Sun, 23 Jun 2019 03:04:38 +0000]
migration_tools.openbiblio2marc

3 weeks agooverzealous; control fields
Jason Etheridge [Sun, 23 Jun 2019 03:03:08 +0000]
overzealous; control fields

3 weeks agovariant of make_stub_bib that takes indicator values
Jason Etheridge [Sat, 22 Jun 2019 19:26:40 +0000]
variant of make_stub_bib that takes indicator values

Signed-off-by: Jason Etheridge <jason@EquinoxInitiative.org>

4 weeks agoalternate versions of the barcode collision handlers.. rebarcodes to migschema +...
Jason Etheridge [Tue, 18 Jun 2019 20:05:15 +0000]
alternate versions of the barcode collision handlers.. rebarcodes to migschema + barcode for incumbent collisions; less robust than the originals but easier for end-users

6 weeks agoadd message to check for it being XML
Rogan Hamby [Thu, 6 Jun 2019 14:56:15 +0000]
add message to check for it being XML

6 weeks agoadding explicit disconnect to save on listeners
Rogan Hamby [Fri, 31 May 2019 14:48:04 +0000]
adding explicit disconnect to save on listeners

7 weeks agomigration_tools.is_circ_rule_safe_to_delete
Jason Etheridge [Thu, 30 May 2019 20:24:25 +0000]
migration_tools.is_circ_rule_safe_to_delete

7 weeks agoadding user setting report
Rogan Hamby [Wed, 29 May 2019 12:29:05 +0000]
adding user setting report

7 weeks agocleaning up notices reports
Rogan Hamby [Tue, 28 May 2019 16:31:25 +0000]
cleaning up notices reports

7 weeks agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Tue, 28 May 2019 16:06:44 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

7 weeks agoadd notices to default mig reports
Rogan Hamby [Tue, 28 May 2019 16:06:28 +0000]
add notices to default mig reports

8 weeks agosimplify git path
Jason Etheridge [Wed, 22 May 2019 17:58:25 +0000]
simplify git path

8 weeks agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Wed, 22 May 2019 15:11:19 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

8 weeks agoadded more bib reports
Rogan Hamby [Wed, 22 May 2019 13:50:03 +0000]
added more bib reports

8 weeks agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Wed, 22 May 2019 12:54:18 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

8 weeks agofixed sql typo
Rogan Hamby [Wed, 22 May 2019 12:53:58 +0000]
fixed sql typo

8 weeks agoremoving looking for usrname collections only on non-deleted records since constraint...
Rogan Hamby [Mon, 20 May 2019 18:44:45 +0000]
removing looking for usrname collections only on non-deleted records since constraint is on all usrnames

8 weeks agocopy/paste-o
Jason Etheridge [Mon, 20 May 2019 12:01:30 +0000]
copy/paste-o

8 weeks agosql vs plpgsql
Jason Etheridge [Sun, 19 May 2019 23:49:33 +0000]
sql vs plpgsql

8 weeks agotypo
Jason Etheridge [Sun, 19 May 2019 23:46:38 +0000]
typo

8 weeks agointernal _handle_shelf we can call without assertions
Jason Etheridge [Sun, 19 May 2019 23:45:16 +0000]
internal _handle_shelf we can call without assertions

8 weeks agodebugging
Jason Etheridge [Sun, 19 May 2019 23:32:25 +0000]
debugging

8 weeks agomigration_tools.munge_sf9_qualifying_match
Jason Etheridge [Sun, 19 May 2019 21:33:10 +0000]
migration_tools.munge_sf9_qualifying_match

2 months agovariation on yet another 856$9 munger
Jason Etheridge [Wed, 15 May 2019 17:53:42 +0000]
variation on yet another 856$9 munger

2 months agomigration_tools.get_marc_tags_filtered
Jason Etheridge [Wed, 15 May 2019 17:40:17 +0000]
migration_tools.get_marc_tags_filtered

2 months agoMerge branch 'master' of git.esilibrary.com:migration-tools to remove unlogged statements
Rogan Hamby [Tue, 14 May 2019 11:58:08 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools to remove unlogged statements

2 months agoremoving the last of the unlogged statements
Rogan Hamby [Tue, 14 May 2019 11:57:47 +0000]
removing the last of the unlogged statements

2 months agofixed bug for mig-stagebibs when the output is already all in a single line
Rogan Hamby [Mon, 13 May 2019 18:19:58 +0000]
fixed bug for mig-stagebibs when the output is already all in a single line

2 months agoadded funcitonality for --marcfile as documentation suggested it had
Rogan Hamby [Mon, 13 May 2019 17:51:06 +0000]
added funcitonality for --marcfile as documentation suggested it had

2 months agodoh
Jason Etheridge [Mon, 13 May 2019 12:28:36 +0000]
doh

Signed-off-by: Jason Etheridge <jason@EquinoxInitiative.org>

2 months agoanother 856$9 munger
Jason Etheridge [Mon, 13 May 2019 12:23:35 +0000]
another 856$9 munger

Signed-off-by: Jason Etheridge <jason@EquinoxInitiative.org>

2 months agomigration_tools.handle_actor_barcode_collisions
Jason Etheridge [Fri, 10 May 2019 16:28:54 +0000]
migration_tools.handle_actor_barcode_collisions

convenience function for handling patron barcode/usrname collisions in actor_usr_legacy

this should be ran prior to populating actor_card

Signed-off-by: Jason Etheridge <jason@EquinoxInitiative.org>

2 months agomigration_tools.handle_asset_barcode_collisions
Jason Etheridge [Fri, 10 May 2019 15:37:29 +0000]
migration_tools.handle_asset_barcode_collisions

convenience function for handling item barcode collisions in asset_copy_legacy

Signed-off-by: Jason Etheridge <jason@EquinoxInitiative.org>

2 months agobibs not loaded report added
Rogan Hamby [Thu, 9 May 2019 20:00:24 +0000]
bibs not loaded report added

2 months agonew mig-loadbibs
Rogan Hamby [Thu, 9 May 2019 19:39:25 +0000]
new mig-loadbibs

2 months agonew faster version of mig-bibload
Rogan Hamby [Thu, 9 May 2019 18:41:55 +0000]
new faster version of mig-bibload

2 months agosimplifying the bibs loaded report and making it specific to loaded not staged
Rogan Hamby [Thu, 2 May 2019 14:25:53 +0000]
simplifying the bibs loaded report and making it specific to loaded not staged

2 months agotypo fixed
Rogan Hamby [Thu, 2 May 2019 14:13:43 +0000]
typo fixed

2 months agoadding a simple counts dedupe report and fixing a typo
Rogan Hamby [Thu, 2 May 2019 13:01:25 +0000]
adding a simple counts dedupe report and fixing a typo

2 months agodedupe report
Rogan Hamby [Wed, 1 May 2019 20:04:49 +0000]
dedupe report

2 months agoMerge branch 'master' of git.esilibrary.com:migration-tools while adding mig reporter...
Rogan Hamby [Wed, 1 May 2019 19:47:15 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools while adding mig reporter report for copy alerts

2 months agoadding asset.copy_alert report
Rogan Hamby [Wed, 1 May 2019 19:46:55 +0000]
adding asset.copy_alert report

2 months agomore concise output for mig-reporter and circs
Jason Etheridge [Tue, 30 Apr 2019 15:46:26 +0000]
more concise output for mig-reporter and circs

3 months agoearly version of a mig pg_dump, untested so far
Rogan Hamby [Tue, 9 Apr 2019 20:14:17 +0000]
early version of a mig pg_dump, untested so far

3 months agofix Experimental unshift on scalar is now forbidden with newer Perl
Jason Etheridge [Mon, 8 Apr 2019 09:11:42 +0000]
fix Experimental unshift on scalar is now forbidden with newer Perl

3 months agoremoving the strict and force since they are superceded by munge
Rogan Hamby [Sat, 6 Apr 2019 18:14:23 +0000]
removing the strict and force since they are superceded by munge

3 months agoadding force and strict add sf9 to replace old add sf9
Rogan Hamby [Sat, 6 Apr 2019 18:11:28 +0000]
adding force and strict add sf9 to replace old add sf9

3 months agoMerge branch 'master' of git.esilibrary.com:migration-tools
Rogan Hamby [Mon, 25 Mar 2019 18:31:57 +0000]
Merge branch 'master' of git.esilibrary.com:migration-tools

3 months agoadding columsn for specifying to migrates items and or patrons on tlc branches
Rogan Hamby [Mon, 25 Mar 2019 18:31:41 +0000]
adding columsn for specifying to migrates items and or patrons on tlc branches

3 months agomigration_tools.name_parse_out_fuller_last_first_middle_and_random_affix2
Jason Etheridge [Sun, 24 Mar 2019 16:59:26 +0000]
migration_tools.name_parse_out_fuller_last_first_middle_and_random_affix2

3 months agoresolve ambiguities if you are working with mapping tables with their own id column
Jason Etheridge [Fri, 22 Mar 2019 15:36:45 +0000]
resolve ambiguities if you are working with mapping tables with their own id column

Signed-off-by: Jason Etheridge <jason@EquinoxInitiative.org>

4 months agoadd new munge_sf9 function
Rogan Hamby [Tue, 26 Feb 2019 12:56:28 +0000]
add new munge_sf9 function

4 months agoremoving the add_sf9 function that doesn't check for indicators or reset them
Rogan Hamby [Tue, 26 Feb 2019 11:45:12 +0000]
removing the add_sf9 function that doesn't check for indicators or reset them

4 months agoavoid trimming trailing empty fields
Jason Etheridge [Wed, 20 Feb 2019 03:28:36 +0000]
avoid trimming trailing empty fields

5 months agoadd asset.copy_alert to default base staging tables
Jason Etheridge [Mon, 21 Jan 2019 05:42:33 +0000]
add asset.copy_alert to default base staging tables

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

5 months agoimperfect but good enough handling of array datatypes for create_linked_legacy_table_from
Jason Etheridge [Sat, 19 Jan 2019 22:31:31 +0000]
imperfect but good enough handling of array datatypes for create_linked_legacy_table_from

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

5 months agomigration_tools.create_linked_legacy_table_from
Jason Etheridge [Sat, 19 Jan 2019 22:03:31 +0000]
migration_tools.create_linked_legacy_table_from

for working outside of mig link/convert

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agobetter usps suffix handling
Jason Etheridge [Thu, 10 Jan 2019 15:49:41 +0000]
better usps suffix handling

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agobetter usps suffix handling
Jason Etheridge [Thu, 10 Jan 2019 15:14:30 +0000]
better usps suffix handling

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agoadd x_org logic to handle_shelf
Jason Etheridge [Wed, 9 Jan 2019 19:35:52 +0000]
add x_org logic to handle_shelf

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agomigration_tools.normalize_address_suffix
Jason Etheridge [Wed, 9 Jan 2019 19:29:43 +0000]
migration_tools.normalize_address_suffix

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

6 months agomigration_tools.split_rows_on_column_with_delimiter
Jason Etheridge [Mon, 7 Jan 2019 20:03:20 +0000]
migration_tools.split_rows_on_column_with_delimiter

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

7 months agomigration_tools.name_parse_out_first_middle_last_comma_suffix
Jason Etheridge [Tue, 18 Dec 2018 00:25:57 +0000]
migration_tools.name_parse_out_first_middle_last_comma_suffix

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

7 months agotool to spit out records that contain the tag/subfield/value combination provided
Jason Etheridge [Tue, 4 Dec 2018 17:23:47 +0000]
tool to spit out records that contain the tag/subfield/value combination provided

8 months agoremove serial reports
Rogan Hamby [Wed, 7 Nov 2018 17:04:47 +0000]
remove serial reports

9 months agohandle ambiguity
Jason Etheridge [Fri, 5 Oct 2018 19:22:58 +0000]
handle ambiguity

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

9 months agomoar columns for bre
Jason Etheridge [Tue, 2 Oct 2018 17:49:45 +0000]
moar columns for bre

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agomig-reporter will now look for a file in the working directory if it's not in migrati...
Rogan Hamby [Mon, 17 Sep 2018 19:57:51 +0000]
mig-reporter will now look for a file in the working directory if it's not in migration-tools/mig-xml/

10 months agoadded documentation to mig-reporter for the captions feature
Rogan Hamby [Mon, 17 Sep 2018 18:52:00 +0000]
added documentation to mig-reporter for the captions feature

10 months agoadd ability to turn captions off in asciidoc with --captions_off parameter
Rogan Hamby [Mon, 17 Sep 2018 18:50:12 +0000]
add ability to turn captions off in asciidoc with --captions_off parameter

10 months agooauth.env no longer uses the export command and they are no longer read as environmen...
Rogan Hamby [Thu, 6 Sep 2018 20:19:53 +0000]
oauth.env no longer uses the export command and they are no longer read as environmental variables, also the optional --authfile is now accepted as a parameter for the file in any location

10 months agofix bug in vivicate for stat cat entries
Jason Etheridge [Tue, 4 Sep 2018 09:59:09 +0000]
fix bug in vivicate for stat cat entries

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agomigration_tools.handle_link3_skip_false
Jason Etheridge [Tue, 4 Sep 2018 09:12:46 +0000]
migration_tools.handle_link3_skip_false

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agomigration_tools.handle_barred_or_blocked
Jason Etheridge [Tue, 4 Sep 2018 08:20:33 +0000]
migration_tools.handle_barred_or_blocked

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agowe need some type-aware functions, but for now...
Jason Etheridge [Tue, 4 Sep 2018 06:09:28 +0000]
we need some type-aware functions, but for now...

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agomigration_tools.handle_link3_skip_true, and remove potential for ambiguous columns...
Jason Etheridge [Tue, 4 Sep 2018 05:53:28 +0000]
migration_tools.handle_link3_skip_true, and remove potential for ambiguous columns for all handle_link*

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agomigration_tools.handle_link3_concat_skip_null
Jason Etheridge [Tue, 4 Sep 2018 05:46:04 +0000]
migration_tools.handle_link3_concat_skip_null

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agomigration_tools.handle_link3_skip_null
Jason Etheridge [Tue, 4 Sep 2018 05:38:35 +0000]
migration_tools.handle_link3_skip_null

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agono btrim for handle_link3
Jason Etheridge [Tue, 4 Sep 2018 05:28:32 +0000]
no btrim for handle_link3

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agohandle_link3
Jason Etheridge [Tue, 4 Sep 2018 05:27:29 +0000]
handle_link3

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agohobgoblins, consistency
Jason Etheridge [Tue, 4 Sep 2018 03:52:05 +0000]
hobgoblins, consistency

Signed-off-by: Jason Etheridge <jason@esilibrary.com>

10 months agoadding default schema name as sheet for common tables
Rogan Hamby [Fri, 31 Aug 2018 19:01:10 +0000]
adding default schema name as sheet for common tables

10 months agoadding sheet tracking to the common tables sql
Rogan Hamby [Fri, 31 Aug 2018 18:44:41 +0000]
adding sheet tracking to the common tables sql

10 months agoremoving redundant env declaration
Rogan Hamby [Fri, 31 Aug 2018 18:39:52 +0000]
removing redundant env declaration

10 months agofix apply_circ_matrix_to_specific_circ
Jason Etheridge [Thu, 23 Aug 2018 20:14:05 +0000]
fix apply_circ_matrix_to_specific_circ

when hitting an item price based max fine rule for an item with no price

we're still using the asset.copy table here and not asset_copy

Signed-off-by: Jason Etheridge <jason@equinoxinitiative.org>

11 months agoadding libraries to the gsheet for patron thresholds
Rogan Hamby [Wed, 15 Aug 2018 14:00:40 +0000]
adding libraries to the gsheet for patron thresholds

11 months ago added function to trim and null out all columns, useful when importing from reports
Rogan Hamby [Mon, 13 Aug 2018 19:27:54 +0000]
 added function to trim and null out all columns, useful when importing from reports

11 months agoupdating create accounts table to match latest sheet format used by PM
Rogan Hamby [Fri, 10 Aug 2018 14:36:23 +0000]
updating create accounts table to match latest sheet format used by PM

11 months agocleaning up bib report and adding source column to it
Rogan Hamby [Wed, 8 Aug 2018 17:45:45 +0000]
cleaning up bib report and adding source column to it

11 months agoadding precats to assets report
Rogan Hamby [Wed, 8 Aug 2018 17:36:27 +0000]
adding precats to assets report