This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
| access:access_server_2013_robustification_project [2013/04/04 00:27] mjallison [Server Architecture Improvements] | access:access_server_2013_robustification_project [2013/04/05 19:02] (current) mjallison [Possible Solutions] | ||
|---|---|---|---|
| Line 15: | Line 15: | ||
| ===== Possible Solutions ===== | ===== Possible Solutions ===== | ||
| + | |||
| + | AWS Tools | ||
| + | * RDS snapshots, currently being done and retained for last 3 days. (50Gib) Can restore from a snapshot.  | ||
| + | * EC2 snaps shots done once per day, keeping last two days (100 GiB) Can restore from snapshot. | ||
| + | * EBS Snapshots can be moved between regions. | ||
| + | * AWS console operations (new instance, snapshot, etc) can be automated. | ||
| Virtual Machine failure recovery strategies | Virtual Machine failure recovery strategies | ||
| Line 41: | Line 47: | ||
| * Most storage issues appear to be related to the Access Java Client, fix it. | * Most storage issues appear to be related to the Access Java Client, fix it. | ||
| * Track storage can be moved to S3, increasing the safety of track storage. | * Track storage can be moved to S3, increasing the safety of track storage. | ||
| + | |||
| + | ===== Recommended Solution ===== | ||
| + | * TBD: Identify robustness goals, recovery speed, etc. to guide solution selection. | ||
| + | * Attend April 30 AWS conference to get briefed on more AWS tech. | ||
| + | * Document modern (2013) system architecture | ||
| + | * Document failover process (for manual recovery), recovery procedures for failure modes.  | ||
| + | * Modify AccessSupport tool to automate instance creation (from existing AMI-create snap of existing AMI, reattach EBS), recover EBS from snaps, repopulate DB from backup snap, | ||
| + | * Modify AccessSupport tool to copy snaps to another region to prep for region failover process.  | ||
| + | * Consider auto copy snaps to another region for backup.  | ||
| ===== Possible Track items to consider at the same time ===== | ===== Possible Track items to consider at the same time ===== | ||
| Likely only make these modifications when we rework a track product | Likely only make these modifications when we rework a track product | ||
| Line 50: | Line 65: | ||
| * SQL customer tables; assetid, association, gps, rtk, rtktrack, track, vehicle | * SQL customer tables; assetid, association, gps, rtk, rtktrack, track, vehicle | ||
| * SQL customer tables; tsm, tmm, device | * SQL customer tables; tsm, tmm, device | ||
| + | * Remove SupportTool tabs for Devices, Trackwork Modules, Trackwork Servers (associated tables if not already present). | ||
| ===== Server Architecture Improvements ===== | ===== Server Architecture Improvements ===== | ||
| The following areas are routine maintenance items and/or feature requests that need to be done. The timing is right to do these at the same time as the other efforts. | The following areas are routine maintenance items and/or feature requests that need to be done. The timing is right to do these at the same time as the other efforts. | ||