[OPLINTECH] OPLIN e-mail failure

Mon Mar 9 15:31:33 EDT 2015

Might as well send it to me.

April 4th is the day we stop waiting to migrate the OPLIN staff to the
state mail hosting, thus oplin.org will no longer point at the
forwarding server.

Karl Jendretzky
IT Manager - Ohio Public Library Information Network
(614) 728-1515
karl at oplin.org

On Mon, Mar 9, 2015 at 2:56 PM, Chad Neeper <cneeper at level9networks.com> wrote:
> Thanks, that should help. Do you want the libraries to send the list to you
> or is there a generic account you'd prefer?
>
> ...What's special about Saturday April 4?
>
>
> ______________________________
> Chad Neeper
> Senior Systems Engineer
>
> Level 9 Networks
> 740-548-8070 (voice)
> 866-214-6607 (fax)
>
> Full IT/Computer consulting services -- Specialized in libraries and schools
>
> On Mon, Mar 9, 2015 at 2:35 PM, Karl Jendretzky <karljendretzky at gmail.com>
> wrote:
>>
>> Here's a bit of a help.
>>
>> I've built a forwarder server that handles all the domains that was on
>> the zimbra server. If a library supplies us with a text file of old
>> address and new addresses, we'll forward the mail through. So at the
>> very least libraries can do what we're doing and forward to things
>> like personal GMail accounts.
>>
>> So as an example the current file reads..
>>
>> jendreka at oplin.org karljendretzky at gmail.com
>> karl at oplin.org karljendretzky at gmail.com
>> director at oplin.org st.hedges at gmail.com
>> hedgesst at oplin.org st.hedges at gmail.com
>> editor at oplin.org oplinsupport at gmail.com
>>
>> This is a server we plan on running until Friday April 3rd to give
>> libraries time to notify vendors of the change of address.
>>
>>
>> Karl Jendretzky
>> IT Manager - Ohio Public Library Information Network
>> (614) 728-1515
>> karl at oplin.org
>>
>>
>> On Mon, Mar 9, 2015 at 1:42 PM, Chad Neeper <cneeper at level9networks.com>
>> wrote:
>> > Thanks! That's actually some of the information I've been looking for.
>> > It
>> > answers the question of whether or not OPLIN will be providing a mail
>> > server
>> > for libraries going forward. It's been very convenient having OPLIN
>> > Support
>> > handling e-mail, but if that was going away eventually anyway, then
>> > you're
>> > right:  we can start looking to alternatives, using a meaningful domain
>> > name.
>> >
>> > Some libraries are setting up a few gmail accounts, but the accounts are
>> > often tied to individuals, sometimes incorporating the individual's name
>> > and
>> > the library's initials or whatever. That's all well and good for now,
>> > but it
>> > could cause a problem down the road if one of those individuals gets
>> > sacked
>> > and decides to use the account for malicious intent. The organization
>> > has no
>> > ability to terminate or lock the account! I'm sure they're not thinking
>> > along those lines right now, though.
>> >
>> > I'm still hoping you'll set up a temp server in the short term just to
>> > receive the mail that they'll otherwise miss. That would go a ways
>> > towards
>> > giving them more time to plan and ease their transition. But this gives
>> > us
>> > some guidance.
>> >
>> > I try not to stress too much about problems. Go ahead and go home.
>> > Relax.
>> > Get some shut-eye.
>> > The problems will still be there tomorrow. ;-)
>> >
>> > Chad
>> >
>> > ______________________________
>> > Chad Neeper
>> > Senior Systems Engineer
>> >
>> > Level 9 Networks
>> > 740-548-8070 (voice)
>> > 866-214-6607 (fax)
>> >
>> > Full IT/Computer consulting services -- Specialized in libraries and
>> > schools
>> >
>> > On Mon, Mar 9, 2015 at 12:56 PM, Stephen Hedges <st.hedges at gmail.com>
>> > wrote:
>> >>
>> >> Well, there's no doubt that any simple mail server would be temporary.
>> >> We're in the process of moving OPLIN office accounts to the State of
>> >> Ohio's
>> >> email service and will eventually need the "oplin.org" name.
>> >>
>> >> This actually might be a good time for libraries to think about
>> >> grabbing a
>> >> domain name that means a little more to their patrons, rather than
>> >> "oplin."
>> >> (Sorry, just trying to find ~some~ kinda silver lining today.)
>> >>
>> >> ---
>> >> Stephen
>> >>
>> >> On Mon, Mar 9, 2015 at 12:50 PM, Chad Neeper
>> >> <cneeper at level9networks.com>
>> >> wrote:
>> >>>
>> >>> A lot of my own small libraries seem to already have a generic
>> >>> non-oplin.org account that they've been using in the meantime. I've
>> >>> just
>> >>> been suggesting they continue to do that for now, but not necessarily
>> >>> start
>> >>> going around to the myriad of organizations they do business with and
>> >>> start
>> >>> en masse switching the e-mail accounts yet until we get some official
>> >>> guidance from OPLIN on what you folks plan to do going forward. If you
>> >>> do
>> >>> decide to set up another mail server, even temporarily, that might
>> >>> impact
>> >>> their knee-jerk responses.
>> >>>
>> >>> Chad
>> >>>
>> >>>
>> >>> ______________________________
>> >>> Chad Neeper
>> >>> Senior Systems Engineer
>> >>>
>> >>> Level 9 Networks
>> >>> 740-548-8070 (voice)
>> >>> 866-214-6607 (fax)
>> >>>
>> >>> Full IT/Computer consulting services -- Specialized in libraries and
>> >>> schools
>> >>>
>> >>> On Mon, Mar 9, 2015 at 12:34 PM, Stephen Hedges <st.hedges at gmail.com>
>> >>> wrote:
>> >>>>
>> >>>> It seems like lotsa folks have already set up gmail accounts,
>> >>>> contacted
>> >>>> their domain host about email, etc., etc. So to avoid confusion, IF
>> >>>> we get a
>> >>>> temporary, simple mail server set up, we'd probably ask folks to
>> >>>> contact us
>> >>>> and request a temporary account.
>> >>>>
>> >>>> ---
>> >>>> Stephen
>> >>>>
>> >>>> On Mon, Mar 9, 2015 at 12:22 PM, Chad Neeper
>> >>>> <cneeper at level9networks.com> wrote:
>> >>>>>
>> >>>>> Didn't think of that. Some accounts may have been hidden, though. I
>> >>>>> often will mark my list membership as unpublished, so my own e-mail
>> >>>>> wouldn't
>> >>>>> necessarily show up. You'd also have to weed out the non-oplin.org
>> >>>>> addresses, but that could be done.
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>> ______________________________
>> >>>>> Chad Neeper
>> >>>>> Senior Systems Engineer
>> >>>>>
>> >>>>> Level 9 Networks
>> >>>>> 740-548-8070 (voice)
>> >>>>> 866-214-6607 (fax)
>> >>>>>
>> >>>>> Full IT/Computer consulting services -- Specialized in libraries and
>> >>>>> schools
>> >>>>>
>> >>>>> On Mon, Mar 9, 2015 at 12:15 PM, Bob Neeper <neeperro at gmail.com>
>> >>>>> wrote:
>> >>>>>>
>> >>>>>> Glad I'm 'retired'.
>> >>>>>>
>> >>>>>> Chad's too kind.  My suggestion.
>> >>>>>>
>> >>>>>> You can get 500 + accounts quickly from the list servers when you
>> >>>>>> log
>> >>>>>> in .
>> >>>>>> Probably most active people watch some of the lists.
>> >>>>>>
>> >>>>>>
>> >>>>>>
>> >>>>>> R. W. (Bob) Neeper
>> >>>>>> (Retired Toledo Scale Engineer & Computer Guy)
>> >>>>>>
>> >>>>>> Volunteering at:
>> >>>>>> Community Library
>> >>>>>> 44 Burrer Dr.
>> >>>>>> Sunbury, Oh 43074
>> >>>>>> Tel:  (740)-965-3901
>> >>>>>>
>> >>>>>>
>> >>>>>>
>> >>>>>>
>> >>>>>> On 3/9/2015 11:46 AM, Chad Neeper wrote:
>> >>>>>>
>> >>>>>> Yeah we thought of that to. Figured you won't know the accounts.
>> >>>>>> The
>> >>>>>> only thing I could come up with was to post a message on the
>> >>>>>> website asking
>> >>>>>> for the directors to get a list of their currently active accounts
>> >>>>>> and
>> >>>>>> forward it to you. The 2600 might whittle down a little in the
>> >>>>>> process. Not
>> >>>>>> ideal, but something.
>> >>>>>>
>> >>>>>> ______________________________
>> >>>>>> Chad Neeper
>> >>>>>> Senior Systems Engineer
>> >>>>>>
>> >>>>>> Level 9 Networks
>> >>>>>> 740-548-8070 (voice)
>> >>>>>> 866-214-6607 (fax)
>> >>>>>>
>> >>>>>> Full IT/Computer consulting services -- Specialized in libraries
>> >>>>>> and
>> >>>>>> schools
>> >>>>>>
>> >>>>>> On Mon, Mar 9, 2015 at 11:43 AM, Karl Jendretzky
>> >>>>>> <karljendretzky at gmail.com> wrote:
>> >>>>>>>
>> >>>>>>> Yeah I'm with you on all those points, and haven't ruled out the
>> >>>>>>> idea
>> >>>>>>> of a failover mail server. Tricky part is that I know which
>> >>>>>>> domains
>> >>>>>>> we
>> >>>>>>> need from the Barracuda but I don't know the 2600 user accounts.
>> >>>>>>>
>> >>>>>>> It's not ruled out.
>> >>>>>>>
>> >>>>>>> Karl Jendretzky
>> >>>>>>> IT Manager - Ohio Public Library Information Network
>> >>>>>>> (614) 728-1515
>> >>>>>>> karl at oplin.org
>> >>>>>>>
>> >>>>>>>
>> >>>>>>> On Mon, Mar 9, 2015 at 11:30 AM, Chad Neeper
>> >>>>>>> <cneeper at level9networks.com> wrote:
>> >>>>>>> > Whaaaat?  You mean you can't turn water into wine? You don't
>> >>>>>>> > have
>> >>>>>>> > unlimited
>> >>>>>>> > resources? You can't turn base metals into gold? My world has
>> >>>>>>> > just
>> >>>>>>> > been
>> >>>>>>> > shattered.
>> >>>>>>> >
>> >>>>>>> > I think probably we all totally understand where you're coming
>> >>>>>>> > from.
>> >>>>>>> > Personally, I greatly appreciate all of the hard work you AND
>> >>>>>>> > the
>> >>>>>>> > rest of
>> >>>>>>> > the team have done over the years. You all deserve an extra
>> >>>>>>> > vacation and pay
>> >>>>>>> > raise. Or at least a nap.
>> >>>>>>> >
>> >>>>>>> > From a library point of view, I'm hoping that you set up another
>> >>>>>>> > mail
>> >>>>>>> > server. Big picture, I'd strongly suspect the amount of time and
>> >>>>>>> > money saved
>> >>>>>>> > is worth it vs. each individual library having to deal with it.
>> >>>>>>> > It
>> >>>>>>> > stinks
>> >>>>>>> > for OPLIN Support, but it's hugely useful, especially for
>> >>>>>>> > smaller
>> >>>>>>> > libraries.
>> >>>>>>> >
>> >>>>>>> > You'll hate this idea too (don't shoot the messenger), but
>> >>>>>>> > someone
>> >>>>>>> > suggested
>> >>>>>>> > to me just now that perhaps you could set up another mail server
>> >>>>>>> > in
>> >>>>>>> > the
>> >>>>>>> > short term and re-create the accounts with the understanding
>> >>>>>>> > that
>> >>>>>>> > all mail
>> >>>>>>> > is gone and this may only be a temporary interim solution. It
>> >>>>>>> > would
>> >>>>>>> > be a
>> >>>>>>> > huge pia for Support to recreate accounts, but it would go a
>> >>>>>>> > long
>> >>>>>>> > way
>> >>>>>>> > towards keeping business running at individual libraries. You
>> >>>>>>> > could
>> >>>>>>> > still
>> >>>>>>> > decide not to continue the service going forward, but it would
>> >>>>>>> > help
>> >>>>>>> > reduce
>> >>>>>>> > the emergency thrust upon the libraries and allow them to more
>> >>>>>>> > gracefully
>> >>>>>>> > switch to another system.
>> >>>>>>> >
>> >>>>>>> > Chad
>> >>>>>>> > ______________________________
>> >>>>>>> > Chad Neeper
>> >>>>>>> > Senior Systems Engineer
>> >>>>>>> >
>> >>>>>>> > Level 9 Networks
>> >>>>>>> > 740-548-8070 (voice)
>> >>>>>>> > 866-214-6607 (fax)
>> >>>>>>> >
>> >>>>>>> > Full IT/Computer consulting services -- Specialized in libraries
>> >>>>>>> > and schools
>> >>>>>>> >
>> >>>>>>> > On Mon, Mar 9, 2015 at 10:41 AM, Karl Jendretzky
>> >>>>>>> > <karljendretzky at gmail.com>
>> >>>>>>> > wrote:
>> >>>>>>> >>
>> >>>>>>> >> Well, frankly trying to host mail with limited staff is what
>> >>>>>>> >> got
>> >>>>>>> >> us in
>> >>>>>>> >> this spot in the first place. OPLIN is 5 people, and I'm the
>> >>>>>>> >> only
>> >>>>>>> >> sysadmin we have. I've been mostly awake since 2:45am on
>> >>>>>>> >> Friday,
>> >>>>>>> >> and
>> >>>>>>> >> though I may be overruled at some point I hope that we don't
>> >>>>>>> >> offer
>> >>>>>>> >> mail any more. Even when working properly it strains the staff
>> >>>>>>> >> an
>> >>>>>>> >> unnecessary amount.
>> >>>>>>> >>
>> >>>>>>> >> Currently I'm in talks with the mail group with the State of
>> >>>>>>> >> Ohio.
>> >>>>>>> >> They work with Microsoft to provide email to state agencies.
>> >>>>>>> >> I'd
>> >>>>>>> >> like
>> >>>>>>> >> to have a info sheet we can give to libraries outlining how
>> >>>>>>> >> they
>> >>>>>>> >> can
>> >>>>>>> >> move onto the state's mail system, but initial response from
>> >>>>>>> >> the
>> >>>>>>> >> state
>> >>>>>>> >> indicates their team might not be able to handle the load. I've
>> >>>>>>> >> got a
>> >>>>>>> >> conference call tomorrow morning with the state mail team, and
>> >>>>>>> >> should
>> >>>>>>> >> know more after.
>> >>>>>>> >>
>> >>>>>>> >> -Karl
>> >>>>>>> >>
>> >>>>>>> >> On Mon, Mar 9, 2015 at 10:30 AM, Chad Neeper
>> >>>>>>> >> <cneeper at level9networks.com>
>> >>>>>>> >> wrote:
>> >>>>>>> >> > Ouch.  Thanks for the info.
>> >>>>>>> >> >
>> >>>>>>> >> > That's a sinking feeling when you're in the middle of it and
>> >>>>>>> >> > watching
>> >>>>>>> >> > the
>> >>>>>>> >> > server not do what it's supposed to. I don't wish that
>> >>>>>>> >> > feeling
>> >>>>>>> >> > on
>> >>>>>>> >> > anyone!
>> >>>>>>> >> >
>> >>>>>>> >> > This is probably early and you may not be ready to announce,
>> >>>>>>> >> > but
>> >>>>>>> >> > any
>> >>>>>>> >> > thoughts to set up another mail server and web front-end
>> >>>>>>> >> > available to
>> >>>>>>> >> > all
>> >>>>>>> >> > libraries, or are you getting out of that game entirely?
>> >>>>>>> >> > Knowing
>> >>>>>>> >> > that
>> >>>>>>> >> > will
>> >>>>>>> >> > help to decide what to do.
>> >>>>>>> >> >
>> >>>>>>> >> > Thanks,
>> >>>>>>> >> > Chad
>> >>>>>>> >> >
>> >>>>>>> >> > ______________________________
>> >>>>>>> >> > Chad Neeper
>> >>>>>>> >> > Senior Systems Engineer
>> >>>>>>> >> >
>> >>>>>>> >> > Level 9 Networks
>> >>>>>>> >> > 740-548-8070 (voice)
>> >>>>>>> >> > 866-214-6607 (fax)
>> >>>>>>> >> >
>> >>>>>>> >> > Full IT/Computer consulting services -- Specialized in
>> >>>>>>> >> > libraries
>> >>>>>>> >> > and
>> >>>>>>> >> > schools
>> >>>>>>> >> >
>> >>>>>>> >> > On Mon, Mar 9, 2015 at 10:09 AM, Karl Jendretzky
>> >>>>>>> >> > <karljendretzky at gmail.com>
>> >>>>>>> >> > wrote:
>> >>>>>>> >> >>
>> >>>>>>> >> >> Everything besides the Zimbra server is running properly.
>> >>>>>>> >> >>
>> >>>>>>> >> >> The Zimbra server was running Ubuntu 10, which is reaching
>> >>>>>>> >> >> end
>> >>>>>>> >> >> of life
>> >>>>>>> >> >> and
>> >>>>>>> >> >> needed updated. The server was pushed to Ubuntu 14, and a
>> >>>>>>> >> >> patch
>> >>>>>>> >> >> was run
>> >>>>>>> >> >> on
>> >>>>>>> >> >> Zimbra to bring it up to date, but after the patching
>> >>>>>>> >> >> finished
>> >>>>>>> >> >> the 80GB
>> >>>>>>> >> >> LDAP
>> >>>>>>> >> >> database was corrupted. Attempts to fix the corrupted
>> >>>>>>> >> >> database
>> >>>>>>> >> >> failed.
>> >>>>>>> >> >> Backups were restored, and a small patch was attempted to
>> >>>>>>> >> >> bring
>> >>>>>>> >> >> it up
>> >>>>>>> >> >> to
>> >>>>>>> >> >> U14, but once again there were LDAP issues. A new Ubuntu 10
>> >>>>>>> >> >> mail server
>> >>>>>>> >> >> was
>> >>>>>>> >> >> built, and the exact version of Zimbra for the backups was
>> >>>>>>> >> >> installed,
>> >>>>>>> >> >> and
>> >>>>>>> >> >> the backup data was put in place, but failed. Each step was
>> >>>>>>> >> >> slightly
>> >>>>>>> >> >> different errors.
>> >>>>>>> >> >>
>> >>>>>>> >> >> My thought is that the Zimbra server went through many
>> >>>>>>> >> >> updates
>> >>>>>>> >> >> through
>> >>>>>>> >> >> it's life, and at some point some of the data went out of
>> >>>>>>> >> >> spec
>> >>>>>>> >> >> just
>> >>>>>>> >> >> enough
>> >>>>>>> >> >> that it could only ever run on the exact U10 environment
>> >>>>>>> >> >> that
>> >>>>>>> >> >> it had.
>> >>>>>>> >> >> That
>> >>>>>>> >> >> U10 environment no longer exists.
>> >>>>>>> >> >>
>> >>>>>>> >> >> Zimbra is a nasty beast. It uses many packages, but none are
>> >>>>>>> >> >> the
>> >>>>>>> >> >> repository default packages. All are bundled with Zimbra,
>> >>>>>>> >> >> and
>> >>>>>>> >> >> all work
>> >>>>>>> >> >> just
>> >>>>>>> >> >> the way Zimbra wants them to, meaning that support resources
>> >>>>>>> >> >> are
>> >>>>>>> >> >> sparse.
>> >>>>>>> >> >>
>> >>>>>>> >> >> The only thing that the Zimbra server was doing was personal
>> >>>>>>> >> >> email
>> >>>>>>> >> >> accounts.
>> >>>>>>> >> >>
>> >>>>>>> >> >> -Karl Jendretzky
>> >>>>>>> >> >>
>> >>>>>>> >> >> _______________________________________________
>> >>>>>>> >> >> OPLINTECH mailing list
>> >>>>>>> >> >> OPLINTECH at lists.oplin.org
>> >>>>>>> >> >> http://lists.oplin.org/mailman/listinfo/oplintech
>> >>>>>>> >> >>
>> >>>>>>> >> >>
>> >>>>>>> >> >
>> >>>>>>> >> >
>> >>>>>>> >> > _______________________________________________
>> >>>>>>> >> > OPLINTECH mailing list
>> >>>>>>> >> > OPLINTECH at lists.oplin.org
>> >>>>>>> >> > http://lists.oplin.org/mailman/listinfo/oplintech
>> >>>>>>> >> >
>> >>>>>>> >> >
>> >>>>>>> >>
>> >>>>>>> >>
>> >>>>>>> >>
>> >>>>>>> >> --
>> >>>>>>> >> -Karl
>> >>>>>>> >> _______________________________________________
>> >>>>>>> >> OPLINTECH mailing list
>> >>>>>>> >> OPLINTECH at lists.oplin.org
>> >>>>>>> >> http://lists.oplin.org/mailman/listinfo/oplintech
>> >>>>>>> >>
>> >>>>>>> >
>> >>>>>>> >
>> >>>>>>> > _______________________________________________
>> >>>>>>> > OPLINTECH mailing list
>> >>>>>>> > OPLINTECH at lists.oplin.org
>> >>>>>>> > http://lists.oplin.org/mailman/listinfo/oplintech
>> >>>>>>> >
>> >>>>>>> >
>> >>>>>>> _______________________________________________
>> >>>>>>> OPLINTECH mailing list
>> >>>>>>> OPLINTECH at lists.oplin.org
>> >>>>>>> http://lists.oplin.org/mailman/listinfo/oplintech
>> >>>>>>>
>> >>>>>>
>> >>>>>>
>> >>>>>>
>> >>>>>> _______________________________________________
>> >>>>>> OPLINTECH mailing list
>> >>>>>> OPLINTECH at lists.oplin.org
>> >>>>>> http://lists.oplin.org/mailman/listinfo/oplintech
>> >>>>>>
>> >>>>>>
>> >>>>>>
>> >>>>>> _______________________________________________
>> >>>>>> OPLINTECH mailing list
>> >>>>>> OPLINTECH at lists.oplin.org
>> >>>>>> http://lists.oplin.org/mailman/listinfo/oplintech
>> >>>>>>
>> >>>>>>
>> >>>>>
>> >>>>>
>> >>>>> _______________________________________________
>> >>>>> OPLINTECH mailing list
>> >>>>> OPLINTECH at lists.oplin.org
>> >>>>> http://lists.oplin.org/mailman/listinfo/oplintech
>> >>>>>
>> >>>>>
>> >>>>
>> >>>
>> >>>
>> >>> _______________________________________________
>> >>> OPLINTECH mailing list
>> >>> OPLINTECH at lists.oplin.org
>> >>> http://lists.oplin.org/mailman/listinfo/oplintech
>> >>>
>> >>>
>> >>
>> >
>> >
>> > _______________________________________________
>> > OPLINTECH mailing list
>> > OPLINTECH at lists.oplin.org
>> > http://lists.oplin.org/mailman/listinfo/oplintech
>> >
>> >
>> _______________________________________________
>> OPLINTECH mailing list
>> OPLINTECH at lists.oplin.org
>> http://lists.oplin.org/mailman/listinfo/oplintech
>>
>
>
> _______________________________________________
> OPLINTECH mailing list
> OPLINTECH at lists.oplin.org
> http://lists.oplin.org/mailman/listinfo/oplintech
>
>