OpenVMS Notes: MIME, SMTP, POP3, etc.

Introduction

References used below

• MIME (Multipurpose Internet Mail Extensions) is a technology for transforming plain text messaging into something more (embedded images, zipped attachments, binary data, etc). Since Y2K, most up-to-date OpenVMS systems are able to create a ZIP file then mail it out as an attachment to PC users. While MIME can be easily supported by any application programmer, interactive VMS users will probably want to use a MIME Utility to encode the data for them.
• MultiNet is a third-party TCP/IP stack for "VMS on VAX" and "OpenVMS on Alpha or Itanium"
• TCPware is a third-party TCP/IP stack for "VMS on VAX" and "OpenVMS on Alpha or Itanium"
• TCPIP Services for OpenVMS is first-party TCP/IP stack for "OpenVMS on Alpha or Itanium"
• UCX (Ultrix Communications eXtensions) is a first-party TCP/IP stack for "VMS on VAX" so those systems could communicate with DEC's version of UNIX called Ultrix

MIME Utilities for OpenVMS

Using $MIME to Create/Send Attachments from OpenVMS Mail

	Prep						Comments
----------------------------------------------------------------------------------
$MIME :== $SYS$SYSTEM:MIME.EXE			! you should do this in SYS$MANAGER:SYLOGIN.COM
$ZIP  yada.zip  *.txt				! create a demo zip file (copy some text files into the zip)
$del/sym/glo	edit				! mime can't deal with this redefined symbol (if it exists) 
$del/sym	edit				! mime can't deal with this redefined symbol (if it exists) 

	Create MIME (interactive only)			Comments
----------------------------------------------------------------------------------
$show symbol edit				! any custom DCL symbol for  here?
     ED*IT == "EDIT/EDT"			! yes
$del/sym/glo edit 				! so delete it
----------------------------------------------------------------------------------
$MIME						! start the MIME application
new  neil.mime					! create a new mime document (starts default OpenVMS editor)
						! caveat: will fail if a custom DCL symbol exists
this is a test					! enter some optional text into editor -OR- not
						! then hit exit/save to go back to MIME
add yada.zip  /encode=base64			! attach zip file to mime document
save						! save mime document
exit						! leave mime
$						! prompt (we're back in DCL)
$mail/subj=yada neil.mime "[email protected]"		! mail the new compound file

	Create MIME (batch or interactive)		Comments
----------------------------------------------------------------------------------
$MIME						! start the MIME application
new/noedit neil.mime				! create a new mime document
add  yada.zip /encode=base64			! attach zip file to mime document
save						! save mime document
exit						! prompt (leave mime)
$						! return to caller (DCL or LIB$DO_COMMAND)

OpenVMS-Editor Keypad-Help

Legend:
	<pf1>		= personal function key #1 (above key pad 7)
	<pf2>		= personal function key #2 (above key pad 8)
	<pf3>		= personal function key #3 (above key pad 9)
	<pf4>		= personal function key #4 (above key pad +)
	<kp7>		= key pad #7
	<f7>		= function #7 (above number key #7)
	<kp enter>	= <enter> key on the keypad
	<enter>		= <enter> key on the main keyboard

Using $MPACK to Create OpenVMS Documents

$!
$! demo DCL script #1 (text-file)
$!
$ MPACK		== "$sys$system:MPACK.EXE"		! define some foreign commands
$ MUNPACK	== "$sys$system:MUNPACK.EXE"		! 
$ MIME		== "$sys$system:MIME.EXE"		! 
$!
$ myfile	= "yada.txt"				! file to attach
$ mpack -s "demo text attachment" -o neil.mime 'myfile'	! create mime equivalent
$!
$! mail methods:
$!
$! send "neil.mime" via VMS MAIL           with "TCPIP for OpenVMS"
$! send "neil.mime" via @mmail_tcpware.com with "TCPware"
$! send "neil.mime" via @mmail.com         with "MultiNet"
$!
$! mail the document
$!
$@MMAIL_TCPWARE.COM neil.mime "[email protected]"	! mail to a PC
$exit							! done

$!
$! demo DCL script #2 (XML-Excel)
$!
$ MPACK		== "$sys$system:MPACK.EXE"		! define some foreign commands
$ MUNPACK	== "$sys$system:MUNPACK.EXE"		! 
$ MIME		== "$sys$system:MIME.EXE"		! 
$ mytemp	== f$unique()+".tmp"			! create a unique file name
$!
$ myfile	= "csmis_w301M_071101.xls"		! attache thisXMLLfilefile for Excel 
$ mpack -s "demo text attachment" -o 'mytemp' -c   -
                  "application/vnd.ms-excel" 'myfile'	! MIME encode the file
$!
$! mail the document
$!
$@MMAIL_TCPWARE.COM 'mytemp' "[email protected]"	! mail to a PC
$exit							! done

Sending Zip Files as an Attachment (various stacks)

Legend: <ur>	= user response
        <sr>	= system response
	!	= start of DCL comments

     ! use $MIME or $MPACK to create a MIME equivalent
<ur>$ mail/subject="test TCPIP for OpenVMS" neil.mime "[email protected]"

<ur>$ def MULTINET_SMTP_ALLOW_MIME_SEND Y
<ur>$ use $MIME or $MPACK to create a MIME equivalent
<ur>$ mail/subject="test MultiNet for OpenVMS" neil.mime "[email protected]"
<ur>$ def MULTINET_SMTP_ALLOW_MIME_SEND N

<ur>$ def TCPWARE_SMTP_ALLOW_MIME_SEND Y
<ur>$ use $MIME or $MPACK to create a MIME equivalent
<ur>$ mail/subject="test TCPware for OpenVMS" neil.mime "[email protected]"
<ur>$ def TCPWARE_SMTP_ALLOW_MIME_SEND N

<ur>$ mail/subject="test-1"/foreign/type=1 neil.zip "[email protected]"
<sr>Sending FOREIGN message as generic MIME-encoded message


notes:
1) MS-Outlook will receive a message with an attachment named "neil.zip"
2) When sending an XML attachment you'll find that part of the email
   header is still present (TCPware 5.7-2 and earlier)

$    set noon
$    say :== write sys$output
$    ask :== inquire/nopunct
$    cr[0,8]=13							! define DCL symbol: carriage return
$    lf[0,8]=10							! define DCL symbol: line feed
$    subject="Port Utilization Report" + cr + lf + -
             "Mime-Version: 1.0"       + cr + lf + -
             "Content-Type: text/html"
$    mail/sub="''subject'" neil.html "[email protected]"
$fini:								!
$    exit							!

MMAIL_TCPWARE.COM (TCPware Version of MMAIL.COM)
(not required with TCPware 5.8)

• download two DCL scripts (MMAIL.COM for MultiNet; MMAIL_TCPWARE.COM for TCPware) to send MIME documents via SMTP

usage  script          p1        p2                    p3   comment

1      @mmail_tcpware  file.txt  "[email protected]"       ! use vms mail queue

2      @mmail_tcpware  file.txt  "[email protected]"  yes  ! copy to port 25
	

$!=============================================================================
$! MMAIL.COM
$! 1.0 original program for MULTINET
$! 16-OCT-1995 David Mathog, Biology Division, Caltech
$!
$! MMAIL_TCPWARE.COM
$! 1.1 modified for use with TCPWARE (works but needs to be more friendly)
$! 2006-03-12 Neil Rieck (Waterloo, Ontario, Canada)
$!
$! 1.2 added RFC-821 compliant time stamps
$! 2007-12-14 Neil Rieck (Waterloo, Ontario, Canada)
$!=============================================================================
$! This procedure mails one or more MPACK produced MIME files to one or 
$! more internet users.
$!
$! The method MMAIL uses is to make a direct entry onto the TCPWARE_SMTP queue.
$! Obviously, this is TCPWARE specific, but something similar should work
$! for other mailers. A second method is provided and has been tested
$! on a TCPWARE system - it will likely need to be tweaked for
$! other TCP/IP vendor's systems. This uses telnet to port 25 on localhost
$! and standard SMTP protocols (which is a bit of a pain). 
$! Before MMAIL will work in the TCPWARE mode somebody with privs
$! must modify the TCPWARE outgoing mail queue to accept submissions from W.
$!
$! P1 File(s) to be mailed - they WILL be deleted!!!!
$! P2 Address(es) to mail to.
$! P3 If defined, use second mode (via port 25) instead of TCPWARE mode.
$! Subject should be inside the MIME messages produced by MPACK.
$! Message-id should be inside the MIME messages produced by MPACK.
$!
$! Thanks to Aaron Leonard for suggesting this method of bypassing
$! MAIL's unbypassable blank line between header and message body.
$!
$! Here are most of the TCPWARE specific pieces, there is also one
$! TCPWARE specific line below.
$!
$ if(f$trnlnm("TCPWARE_ROOT") .nes. "" .and. "''P3'" .eqs. "")
$ then
$ whichqueue = f$trnlnm("TCPWARE_SMTP_QUEUE")
$ sendit :== submit/que='whichqueue'/delete &fileo
$ thisnode = f$trnlnm("TCPWARE_SMTP_HOST_NAME")
$ method = "TCPWARE"
$ else
$ write sys$Output "WARNING, this is a demonstration mode only!"
$ sendit :== @"'fileo'"
$ inquire thisnode "enter your internet node name"
$ method = "DEMO"
$ endif
$!
$! pieces common to both methods
$!
$ now = f$time() !
$ username = f$getjpi("","USERNAME") !
$ username = f$edit(username,"COLLAPSE") !
$ tempname = "kill_" + username + "_" + -
now - "-" - "-" - " " - ":" - ":" - ":" - "."
$!
$! produce an RFA-821 compliant date
$!
$ snap = f$time() ! snap shot of time
$ day = f$cvtime(snap,,"DAY") !
$ month = f$cvtime(snap,"ABSOLUTE","MONTH") !
$ year = f$cvtime(snap,,"YEAR") !
$ hour = f$cvtime(snap,,"HOUR") !
$ min = f$cvtime(snap,,"MINUTE") !
$ sec = f$cvtime(snap,,"SECOND") !
$ zone = f$trnlnm("TCPWARE_TIMEZONE_NAME") !
$ yada = day +" "+ month +" "+ year +" "+ hour +":"+ min +":"+ sec +" "+ zone
$! write sys$output "neil-debug: ",yada
$!
$!
$!
$!
$ if("''P1'" .eqs. "")
$ then
$ type sys$input

Here are examples of valid comma delimited file lists, telling MMAIL which
files to send out (which also deletes them):

outfile.txt

or

outfile*.txt

or

outfile1.txt, outfile2.txt, outfile3.txt, others.*


****************************************************************************
* IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT: *
* *
* MMAIL deletes any file that it mails!!!! *
* If this isn't what you want, hit ^Y now and make copies to mail. *
* *
* IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT: *
****************************************************************************

$ inquire filelist "Please enter a comma delimited list of files to mail"
$ else
$ filelist = P1
$ endif
$!
$ if("''P2'" .eqs. "")
$ then
$ type sys$Input

This procedure sends mail to a comma delimited list of internet addresses. 
For instance: 

"[email protected]"

or

"[email protected], [email protected], [email protected]"

****************************************************************************
* IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT: *
* *
* Enclose everything in double quotes to maintain the case *
* that you type, otherwise, it will be converted to upper case. This *
* will usually break mail delivery to Unix systems, where the user's name *
* is fred, not FRED! *
* *
* IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT: *
****************************************************************************
$ inquire addresslist "Please enter the addresslist now"
$ else
$ addresslist = P2
$ endif
$!
$! Now start actually doing things
$!
$ open/write tfil: sys$scratch:'tempname'_header.txt
$!
$!
$!
$ if(method .eqs. "DEMO")
$ then
$ write tfil: "$ telnet/port=25/create/logical=telnet-nty localhost"
$ write tfil: "$ copy sys$input 'f$trnlnm(""telnet-nty"")"
$ write tfil: "HELO"
$ endif
$!
$! This next section prepares a header file that will go on the front of
$! each outgoing message.
$!
$ write tfil: "MAIL FROM:<''username'>"
$!
$! one or more valid addresses
$!
$count=0
$top_address:
$ address=f$element(count,",",addresslist)
$ if(address .nes. ",")
$ then
$ write tfil: "RCPT TO:<''address'>"
$ count = count + 1
$ goto top_address
$ endif
$ address_count = count
$!
$ if(method .eqs. "TCPWARE")
$ then
$ write tfil: "ARRIVAL_TIME: ''yada'"
$ endif
$ if(method .eqs. "DEMO")
$ then
$ write tfil: "DATA"
$ endif
$ write tfil: "Date: ''yada'"
$!
$! These next two are self evident
$!
$ write tfil: "From: ''username'@''thisnode'"
$ write tfil: "To: ''addresslist'"
$!
$ close tfil:
$!
$! Now, send all of the files
$!
$ ALLCOUNT = 0
$ COUNT = -1
$ lastfile="+++"
$top_files:
$ count = count + 1
$ file=f$element(count,",",filelist)
$ if(file .nes. ",")
$ then
$ file = f$edit(file,"COLLAPSE")
$ sent = 0
$!
$!
$!
$top_out:
$ ofile=f$search(file)
$ if(ofile .eqs. lastfile)then goto top_files
$ lastfile = ofile
$ if(ofile .eqs. "")
$ then
$ if(sent .eq. 0)
$ then
$ write sys$output "Fatal error: ''file' does not exist"
$ delete sys$scratch:'tempname'_header.txt.*
$ exit
$ else
$ goto top_files
$ endif
$ else
$ allcount = allcount + 1
$ fileo := "sys$scratch:''tempname'_''allcount'.dat"
$ fileh := "sys$scratch:''tempname'_header.txt"
$ filet := "sys$scratch:''tempname'_temp.dat"
$ convert/fdl=sys$input 'fileh' 'filet'
RECORD
BLOCK_SPAN yes
CARRIAGE_CONTROL carriage_return
FORMAT stream_lf
SIZE 32767
$ append/new 'filet','ofile' 'fileo'
$ delete 'filet';
$ delete 'ofile'
$ if (method .eqs. "TCPWARE")then sendit
$ if (method .eqs. "DEMO")
$ then
$ open/append gfil: 'fileo'
$ write gfil: "."
$ write gfil: "QUIT"
$ write gfil: "$! end of message"
$ write gfil: "$ dealloc 'f$trnlnm(""telnet-nty"")"
$ write gfil: "$ wait 00:00:01"
$ close gfil:
$ @'fileo'
$ delete 'fileo';
$ endif
$ sent = sent + 1
$ goto top_out
$ endif
$!
$!
$!
$ goto top_files
$ endif
$!
$ write sys$output -
"''Allcount' files have been mailed to ''address_count' addresses"
$ delete sys$scratch:'tempname'_header.txt.*
$ exit
$!

Mailing attachments from DCL with TCPware 5.8
(also works with MultiNet)

$!============================================================ 
$! title  : mime_hack.com
$! author : Neil Rieck 
$! created: 2008-06-12 
$!============================================================ 
$!
$ MIME :== $SYS$SYSTEM:MIME.EXE				! add this line to sys$manager:sylogin.com
$!
$ say := write sys$output				!
$! 
$!           method #1 (works as-is with TCPware 5.8) 
$! 
$ say "mailing test #1"                     		!
$ mail/subj="mime test 1"/for/type=1 SCR-2008H1.zip "[email protected]"
$!
$!           method #2 (prep)
$!
$ say "building MIME file"                  		!
$ wait 0:00:01                              		!
$ MIME                                      		! start the MIME application
new/noedit neil.mime                        		! create a new mime document
add/encod=base64 SCR-2008H1.zip             		!
save                                        		! save mime document
exit                                        		! prompt (leave mime)
$!
$!           method #2 (works with new TCPware 5.8 logical) 
$! 
$ say "mailing test #2"                     		!
$ def tcpware_smtp_allow_mime_send y        		! we want new functionality
$ mail/subj="mime test 2" neil.mime "[email protected]"
$ deas tcpware_smtp_allow_mime_send         		! disable new functionality
$ say "adios"                               		!

Using a MIME template to send a high 'priority email'

1. The reason we do this three times (see yellow highlights below) is to ensure we trigger logic in all popular email clients.
    
2. Like all HTTP headers. You need a blank line between the last MIME directive and the beginning of the message payload.
    
3. For processing correct code, a DCL-based program could use all the lines up to "Message-ID" as a template. After that you would invoke DCL lexical "f$unique()" to produce a new "Message-ID:". Then you would just tack on the plaint text message before invoking $MAIL
    
4. Special note for spammers with visions of grandeur: sending an email with high priority will not cause your mail to be delivered any faster. It is only read by the receiving email client and may raise a red flag or enable a red exclamation

$!============================================================
$! title  : SEND_FAKE_MAIL.COM (for TCPware 5.8)
$! author : Neil Rieck 
$! created: 2009-03-16 
$!============================================================
$ set ver						!
$ def TCPWARE_SMTP_ALLOW_MIME_SEND Y			! enable new feature (process level)
$							! send to PC
$ mail /subj="fake 1" AAA_fake_mail.txt "[email protected]"
$							! send to my "Bell Canada" Cell Phone 
$ MAIL /subj="fake 2" AAA_fake_mail.txt "[email protected]"
$ deas TCPWARE_SMTP_ALLOW_MIME_SEND			! disable new feature
$ set nover						!
$!
$!
$!
$ type AAA_fake_mail.txt
Mime-version: 1.0
Content-Type: text/plain; charset=windows-1252
Content-Disposition: inline
Content-Transfer-Encoding: 7bit
X-Priority: 1
X-MSMail-Priority: High
Importance: high
Message-ID: <[email protected]>

This is a test message from Neil.
Bye For Now.

Using TELNET to simulate an SMTP transaction

Caveat: SMTP is only used to SEND mail
Notes : When your DCL-based-apps encounter problems sending through the VMS Mail client, just talk directly to
        port 25 (you can do this in DCL by calling TELNET or from within a high level language like BASIC or "C")
Source: kawc15
Dest  : kawc09
Legend: <ur> user response
        <sr> system response
---------------------------------------------------------------------------
<ur> $telnet kawc09.on.bell.ca 25                                          ! connect to remote SMTP port
<sr> %TCPWARE_TELNET-I-TRYING, trying kawc09.on.bell.ca,smtp (142.180.39.16,25) ...
<sr> %TCPWARE_TELNET-I-ESCCHR, escape (attention) character is "^\"
<sr> 220 kawc09.on.bell.ca Process Software ESMTP service V5.8-2 ready at Fri, 24 Apr 2009 17:14:45 EDT
<ur> HELO kawc15.on.bell.ca                                                ! begin by saying HELO, I am so-and-so
<sr> 250 kawc09.on.bell.ca ; Hello kawc15.on.bell.ca [142.180.39.15], pleased to meet you.
<ur> MAIL FROM:<[email protected]>                                    !
<sr> 250 sender <[email protected]> OK                                !
<ur> RCPT TO:<[email protected]>                                    !
<sr> 250 <[email protected]> OK - delivered as <system>             !
<ur> RCPT TO:<[email protected]>                                 !
<sr> 250 <[email protected]> OK - delivered as <custodian>       !
<ur> RCPT TO:<[email protected]>                                   !
<sr> 250 <[email protected]> OK - delivered as <dilbert>           !
<ur> DATA                                                                  !
<sr> 354 Start mail input; end with <CRLF>.<CRLF>                          !
<ur> Date: 24 Apr 2009 17:15 EDT                                           !
<ur> From: [email protected]                                          !
<ur> Subject: This is an SMTP hack                                         !
<ur> To: [email protected], [email protected]             !
<ur> CC: [email protected]                                         !
<ur>                                                                       ! blank line indicates end of HTTP header
<ur> Dear Staff:
<ur>
<ur> Take the rest of the week off.
<ur>
<ur> Neil
<ur> <cr><lf>.<cr><lf>                                                     ! this sequence escapes DATA mode
<sr> 250 OK ; Job SMTP-NETMAIL (queue SMTP_KAWC09, entry 757) started on SMTP_KAWC09
<ur> QUIT                                                                  ! we are done
<sr> 221 kawc09.on.bell.ca Process Software ESMTP service V5.8-2 complete at Fri, 24 Apr 2009 17:16:24 -0400
<sr> $                                                                     ! DCL prompt

Notes : When an OpenVMS process sends to the local SMTP server, missing data is auto-filled by SMTP
Source: kawc15
Dest  : 127.0.0.1
Legend: <ur> user response
        <sr> system response
---------------------------------------------------------------------------
<ur> $telnet  127.0.0.1  25                                                ! connect to local SMTP port
<sr> %TCPWARE_TELNET-I-TRYING, trying localhost,smtp (127.0.0.1,25) ...
<sr> %TCPWARE_TELNET-I-ESCCHR, escape (attention) character is "^\"
<sr> 220 kawc15.on.bell.ca Process Software ESMTP service V5.8-2 ready at Fri, 24 Apr 2009 17:38:34 -0400
<ur> HELO kawc15.on.bell.ca                                                ! begin by saying HELO, I am so-and-so
<sr> 250 kawc09.on.bell.ca ; Hello kawc15.on.bell.ca [142.180.39.15], pleased to meet you.
<ur> MAIL FROM:<[email protected]>                                    !
<sr> 250 sender <[email protected]> OK                                !
<ur> RCPT TO:<[email protected]>                                           !
<sr> 250 <[email protected]> OK - delivered as <nobody>             !
<ur> DATA                                                                  !
<sr> 354 Start mail input; end with <CRLF>.<CRLF>                          !
<ur> To: [email protected]                                                 !
<ur> Subject: This is an SMTP hack                                         !
<ur>                                                                       ! blank line indicates end of HTTP header
<ur> Dear Staff:
<ur>
<ur> Take the rest of the week off.
<ur>
<ur> Neil
<ur> <cr><lf>.<cr><lf>                                                     ! this sequence escapes DATA mode
<sr> 250 OK ; Job SMTP-NETMAIL (queue SMTP_KAWC09, entry 757) started on SMTP_KAWC09
<ur> QUIT                                                                  ! we are done
<sr> 221 kawc09.on.bell.ca Process Software ESMTP service V5.8-2 complete at Fri, 24 Apr 2009 17:16:24 -0400
<sr> $                                                                     ! DCL prompt

Click here for more details:

• https://en.wikipedia.org/wiki/SMTP (contains sample communications)
• http://tools.ietf.org/html/rfc821
• http://www.faqs.org/rfcs/rfc821.html
• Download an OpenVMS BASIC demo to show how to use TCPware to interface with an SMTP server
• Click OpenVMS Notes SSL if you need to develop POP3-based apps for port 995 (a.k.a. POP3S)

Using TELNET to simulate an POP3 transaction

Notes:

1. POP3 (Post Office Protocol) is only used to retrieve email from its final delivery location
   https://en.wikipedia.org/wiki/Pop3 (contains sample communications)
    
2. POP3 was succeeded by IMAP4 (Internet Message Access Protocol)
   https://en.wikipedia.org/wiki/IMAP4
    
3. Download an OpenVMS BASIC demo to show how to use TCPware to interface with a POP3 server

External Links

• h41379.www4.hpe.com/wizard/wiz_5880.html - Prerequisites for using MIME?
• h41379.www4.hpe.com/wizard/wiz_4492.html - MAIL, SMTP, MIME, and attachments? (take II)
• h41379.www4.hpe.com/wizard/wiz_0946.html - MIME headers for SMTP mail?
• h41379.www4.hpe.com/faq/openvms_faq.html - FAQ published 2005-09