Current File : //lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyc
�
��Xc @ s� d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m
Z
m Z d d l m
Z
d d l Z d d l Z d d l Z d d l m Z m Z m Z m Z d d l m Z d d l m Z d d l m Z d d l m Z d d l m Z d d
l! m" Z" d d l# m$ Z$ d d
d Z% d e& f d � � YZ' d e& f d � � YZ( d e& f d � � YZ) d � Z* d � Z+ d S( i����N( t Argt MutuallyExclusiveArgList( t
ArgumentError( t b64encoded_file_contentst delimited_listt filesizet manifest_block_device_mappings( t DescribeServiceCertificates( t CheckBucket( t CreateBucket( t GetObject( t
PostObject( t PutObject( t AWSErrori
i i t BundleCreatingMixinc B sr e Z e d d d d d e d d �e d d d d �e d
d d d d d
�e d d d e d dO d d �e d d d d d d �e d d d d d d �e d d d d d �e d d! d d" d d# �e d$ d d% d d& �e d' d d% d d( �e d) d* dP d d+ �e d, d* dP d e j �e d- d* dP d e j �e d. d/ d d0 d1 e d d2 �e d3 d d4 d1 e d5 � d6 g d d7 �e d8 d dQ d6 d9 d e j �e d< d1 e d d= �e d> d1 e d6 d? d e j �e d@ d1 dA � d e j �e dB d1 dC � d e j �e dD dE dF d e j �g Z
dG � Z dH � Z dI � Z
dJ � Z dK � Z dL � Z e dM � Z e dN � Z RS(R s -is --imaget metavart FILEt requiredt helps. file containing the image to bundle (required)s -ps --prefixs� the file name prefix to give the
bundle's files (required when bundling stdin; otherwise
defaults to the image's file name)s -ds
--destinationt DIRs� location to place
the bundle's files (default: dir named by TMPDIR, TEMP, or TMP
environment variables, or otherwise /var/tmp)s -rs --archt choicest i386t x86_64t armhft ppct ppc64t ppc64les# the image's architecture (required)s -ks --privatekeys� file containing
your private key to sign the bundle's manifest with. If one
is not available the bundle will not be signed.s -cs --certs� file containing
your X.509 certificate. If one is not available it
will not be possible to unbundle the bundle without
cloud administrator assistance.s --ec2certs� file containing the
cloud's X.509 certificate. If one is not available
locally it must be available from the bootstrap
service.s -us --usert ACCOUNTs your account IDs --kernelt IMAGEsK ID of the kernel image to
associate with this machine images --ramdisksL ID of the ramdisk image
to associate with this machine images --bootstrap-urlt route_tos| [Eucalyptus
only] bootstrap service endpoint URL (used for obtaining
--ec2cert automaticallys --bootstrap-services --bootstrap-auths -Bs --block-device-mappingss% VIRTUAL1=DEVICE1,VIRTUAL2=DEVICE2,...t types` block device mapping scheme with which to launch
instances of this machine images --productcodess CODE1,CODE2,...t ,t defaults3 comma-separated list of product codes for the images --image-typet machinet kernelt ramdisks --image-sizes? the image's size
(required when bundling stdin)s --part-sizei � s --enc-keyc C s
t | d � S( Ni ( t int( t s( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt <lambda>w s s --enc-ivc C s
t | d � S( Ni ( R$ ( R% ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyR& y s s --batcht actiont
store_truec C sD | j j d � s� | j j d � } d t j k r\ | j j d � t j d � | j d <q� | r� | j j d � | | j d <q� n | j j d � r� | j d j d d � | j d <n | j j d � s� t
d � � n | j j d | j d � | j j d
� s�| j j d � } d t j k rQ| j j d
� t j d � | j d
<q�d t j k r�| j j d
� t j d � | j d
<q�| r�| j j d � | | j d
<q�n | j j d
� rt j j t j j
| j d
� � | j d
<t | j d
d � n | j j d | j j d
� � | j j d � s�| j j d � } d t j k r�| j j d � t j d � | j d <n d t j k r�| j j d � t j d � | j d <q�| r�| j j d � | | j d <q�n | j j d � r8t j j t j j
| j d � � | j d <t | j d d � n | j j d | j j d � � | j j d � s�| j j d � } d t j k r�| j j d � t j d � | j d <q�| r�| j j d � | | j d <q�| j j d � r�| j j d � r�y$ | j | j d | j d � } Wn` t k
r�} | j j d d! t �| j j d" k rdd# } n d$ } t j t
| � | � n X| r�| j j d% � | | j d <q�q�n | j j d � rt j j t j j
| j d � � | j d <t | j d d& � n | j j d � s&t
d' � � n | j j d( | j d � d S() Nt users
account-idt EC2_USER_IDs! using account ID from environments# using account ID from configurationt -t s1 missing account ID; please supply one with --users account ID: %st certt certificatet EC2_CERTs" using certificate from environmentt EUCA_CERTs$ using certificate from configurations user certificates certificate: %st
privatekeys private-keyt EC2_PRIVATE_KEYs" using private key from environmentt EUCA_PRIVATE_KEYs$ using private key from configurations private keys private key: %st ec2certt EUCALYPTUS_CERTs( using cloud certificate from environments* using cloud certificate from configurationt bootstrap_servicet bootstrap_auths failed to fetch ec2certt exc_infoi� s� permission error retrieving cloud certificate; please supply one with --ec2cert or obtain an IAM policy that allows "euserv:DescribeServiceCertificates"sD error retrieving cloud certificate; please supply one with --ec2certs. using cloud certificate from bootstrap services cloud certificates} missing cloud certificate; please supply one with --ec2cert or use --bootstrap-url and access keys to fetch one automaticallys cloud certificate: %s( t argst gett configt get_user_optiont ost environt logt debugt getenvt replaceR t patht
expandusert
expandvarst _assert_is_filet get_region_optiont, _BundleCreatingMixin__get_bundle_certificateR
t Truet responset status_codet sixt
raise_from( t selft
config_valt fetched_certt errt msg( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt configure_bundle_creds� s� #
c C s� | j j d � rd t j j | j d � rd t j j | j d � rd t d j | j d � � � n | j d d k r� t j t j t
j j � � � | j d <| j j d � s� t d � � n | j j d � s�t d � � q�n� t
| j d t j � r�| j j d � s2t j j | j d � | j d <n | j j d � sgt j j | j d � | j d <n t | j d � | j d <nB | j j d � s�t d � � n | j j d � s�t d
� � n | j d t k r�| j j d | j d t � n d S( Nt destinations3 argument -d/--destination: '{0}' is not a directoryt imageR+ t prefixs1 argument --prefix is required when bundling stdint
image_sizes5 argument --image-size is required when bundling stdins9 argument --prefix is required when bundling a file objects= argument --image-size is required when bundling a file objects8 image is incompatible with EC2 due to its size (%i > %i)( R9 R: R= RC t existst isdirR t formatt fdopent dupt syst stdint filenot
isinstanceRL t string_typest basenamet euca2oolst utilt get_filesizet opent EC2_BUNDLE_SIZE_LIMITR? t warn( RN ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt configure_bundle_output� s8 ( # c C sl | j j d � d k r( d | j d <n | j j d � d k rP d | j d <n | j d d k r� | j j d � r� | j d d k r� t d � � n | j j d � r� t d � � n | j j d � r� t d � � q� n | j d d k rh| j j d � rt d � � n | j j d � rD| j d d k rDt d
� � n | j j d � rht d � � qhn d S( NR" t truet
image_typeR# s: argument --kernel: not compatible with image type 'kernel's; argument --ramdisk: not compatible with image type 'kernel't block_device_mappingssL argument -B/--block-device-mappings: not compatible with image type 'kernel's; argument --kernel: not compatible with image type 'ramdisk's< argument --ramdisk: not compatible with image type 'ramdisk'sM argument -B/--block-device-mappings: not compatible with image type 'ramdisk'( R9 R: R ( RN ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt configure_bundle_properties s$ %%c C s� t j � } | j j d � r> | j j d � | j d } n | j d � } | j j d � r | j j d � | j d } n | j d � } d j | � | j d <d j | � | j d <d S( Nt enc_keys using preexisting encryption keyi� t enc_ivs using preexisting encryption IVs {0:0>32x}( t randomt SystemRandomR9 R: R? t infot getrandbitsRZ ( RN t srandt enc_key_it enc_iv_i( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt generate_encryption_keys s c
C s� | j j d � t d | j d | j j d | d | d d d d � } | j � } x� | j d
� pg g D]� } | j d � d k rh | j d
� d k rh t j d t � } | j
| d � | j j � | j
| j d <t j t j | j
� | j
Sqh Wd S( Ns= attempting to obtain cloud certificate from bootstrap serviceR; t loglevelt servicet autht Formatt pemt FingerprintDigests SHA-256t serviceCertificatest certificateUsages image-bundlingt serviceTypet computet deleteR. R4 ( R? Rr R R; t levelt mainR: t tempfilet NamedTemporaryFilet Falset writet filet flusht nameR9 t atexitt registerR= t remove( RN R6 R7 t reqRJ R- t cert_file( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt __get_bundle_certificate. s
c C sQ t j j j d | j j � } | j d | _ | j j d � | _ | j j d � | _
| j j d � r� | j j | j d � n | j j d � r� | j
j | j d � n | j d | _ | j d | _ | j d | _ | | _ d
| _ | j d | _ t d � | D� � | _ | j d
| _ | j d | _ d | _ | | _ | S( NRx t archR" R# Rl t productcodesRV R) Rk t SHA1RW c s s | ] } | j Vq d S( N( t size( t .0t part( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pys <genexpr>S s Rn Ro s AES-128-CBC( Rc t bundlet manifestt BundleManifestR? R� R9 t
image_archR: t kernel_idt
ramdisk_idRl t updatet
product_codest extendt
image_namet
account_idRk t image_digestt image_digest_algorithmRW t sumt bundled_image_sizeRn Ro t
enc_algorithmt image_parts( RN t digestt partinfoR� ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt build_manifestB s, c C s8 t | d � �# } | j | j | d | �� Wd QXd S( Nt wt pretty_print( Rf R� t dump_manifest_to_str( RN R� t filenameR� t
manifest_file( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt dump_manifest_to_fileZ s c C s. | j | j d | j d | j d d | �S( NR1 R- R4 R� ( t dump_to_strR9 ( RN R� R� ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyR� _ s
( R R R R R R N( s machines kernels ramdisk( t __name__t
__module__R RI t Nonet argparset SUPPRESSR R R t ARGSRS Ri Rm Rw RH R� R� R� R� ( ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyR 9 sd
b " t BundleUploadingMixinc B s e Z e d d d d d e d d �e d d d d
d) d d
�e e d d d d d d e j d d �e d d d d d d e d d �� e d d d d d �e d d d �e d d d d d d d! d d" d d# �g Z d$ � Z d% � Z
d& � Z e d' � Z
d* d* d( � Z RS(+ s -bs --bucketR s BUCKET[/PREFIX]R R s) bucket to upload the bundle to (required)s --aclR s
aws-exec-readR s public-reads ec2-bundle-readsQ canned ACL policy to apply to the bundle (default:
aws-exec-read)s --upload-policyt destt
upload_policyt POLICYR s& upload policy to use for authorizations --upload-policy-fileR sM file containing an upload policy to use for
authorizations --upload-policy-signaturet SIGNATUREsY signature for the upload policy (required when an
'upload policy is used)s
--locations� location constraint of the destination
bucket (default: inferred from s3-location-constraint in
configuration, or otherwise none)s --retryt retriesR' t store_constt consti i s" retry failed uploads up to 5 timesc C sm | j j d � ri | j j d � s3 t d � � n | j j d � sT t d � � n d | _ d | _ n d S( NR� t key_ids: -I/--access-key-id is required when using an upload policyt upload_policy_signaturesA --upload-policy-signature is required when using an upload policy( R9 R: R R� Rz t
AUTH_CLASS( RN ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt configure_bundle_upload_auth} s c C sN | j d j d � \ } } } | rB | j d � rB | d 7} n | d | S( Nt buckett /( R9 t partitiont endswith( RN R� t _RV ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt get_bundle_key_prefix� s
c C s� | j j d � r& | j j d � d S| j d j d d � d } y# t j | d | �} | j � Wnl t k
r� } | j d k r� | j j d | � t
j | d | d | j j d � �} | j � q� � n Xd S(
NR� s6 using an upload policy; not verifying bucket existenceR� R� i i i� s creating bucket '%s't location( R9 R: R? Rr t splitR t
from_otherR� R
RK R ( RN R� R� RQ ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt ensure_dest_bucket_exists� s !
c K s" | j j d � r� | r$ | Gd GHn | j j d � rM i | j d d 6} n i } | j | � t j | d | d | d | j j d � p� d d | j d d
| j d d | j d
| �} nT t j | d | d | d | j j d � p� d d | j j d � pd d | | �} | j � d S( NR� s uploading...t security_tokens x-amz-security-tokent sourceR� t acls
aws-exec-readt Policyt SignatureR� t AWSAccessKeyIdR� R� i t
show_progress( R9 R: R� R R� R R� ( RN R� R� R� t
putobj_kwargst postobj_kwargsR� ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt upload_bundle_file� s&
c K s� z� y� xz t r� | j � } | t j j | j � } | j | j | | � | d k rc | j � n | d k r | j | � q q WWn t
k
r� d SXWd | j � | d k r� | j � n Xd S( N( RI t recvR= RC Rb R� R� R� t releaset sendt EOFErrort close( RN t partinfo_in_mpconnt
key_prefixt partinfo_out_mpconnt part_write_semR� R� R� ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt upload_bundle_parts� s
( s public-reads
aws-exec-reads ec2-bundle-readN( R� R� R RI R t base64t b64encodeR R� R� R� R� R� R� R� R� ( ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyR� e s. t BundleDownloadingMixinc B s� e Z e d d d d d e d d d d �e e d d d
d d d d d �e d
d d
d d d d d � d d �e d d
d d d d d d d �� j � g Z d d � Z d � Z d � Z
d � Z d � Z d � Z
RS( s -bs --bucketR s BUCKET[/PREFIX]R R R s\ the bucket that contains the bundle,
with an optional path prefix (required)s -ms
--manifestR� R� sl the manifest's complete file name, not including
any path that may be specified using -bs -ps --prefixR c C s | d S( Ns
.manifest.xml( ( t x( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyR& � s sY the portion of the manifest's file name that
precedes ".manifest.xml"s --local-manifestt local_manifestR sS use a manifest on disk and ignore
any that appear on the serverc C s9 | j j d � rI t | j d d � t j j j j | j d d | �S| j � } t j
� �� } | j j d | � t
j | d | d | d | �} y | j � WnS t k
r� } | j d k r� | j j d d
t �t d j | � � � n � n X| j � | j d � t j j j j | d | �SWd QXd S(
NR� R� t privkey_filenames reading manifest from %sRy R� R� i� s failed to fetch manifestR8 s+ manifest '{0}' does not exist on the serveri ( R9 R: RF Rc R� R� R� t read_from_filet get_manifest_s3pathR� t
TemporaryFileR? Rr R
R� R� R
RK R@ RI t
ValueErrorRZ R� t seekt read_from_fileobj( RN t
s3_serviceR� t manifest_s3patht manifest_tempfileR� RQ ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt fetch_manifest� s,
c C s; | j j d � r3 d j | j d | j d f � Sd Sd S( NR� R� R� ( R9 R: t joinR� ( RN ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyR� s !c
C sL | j | � } x� | D]� \ } } t j j | t j j | � � | _ | j j d | | j � t j | d | d | d | j d | j
j d t � �} | j
� } | j | | | � q W| j � } | rHt j j | t j j | � � }
| j j d | |
� t j | d | d | d |
d | j
j d t � �} | j
� |
Sd S( Ns downloading part %s to %sRy R� R� R� s downloading manifest %s to %s( t map_bundle_parts_to_s3pathsR= RC R� Rb R� R? Rr R
R� R9 R: R� R� t( _BundleDownloadingMixin__check_part_sha1R� R� ( RN R� t dest_dirR� t partsR� t part_s3pathR� RJ R� t
manifest_dest( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt download_bundle_to_dir s2
c
C s� | j | � } x| | D]t \ } } | j j d | � t j | d | d | d | d | j j d t � �} | j � } | j | | | � q Wd S( Ns downloading part %sRy R� R� R� (
R� R? Rr R
R� R9 R: R� R� R� ( RN R� t fileobjR� R� R� R� R� RJ ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt download_bundle_to_fileobj/ s c C sJ g } x= | j D]2 } | j | d j | j d | j f � f � q W| S( NR� R� ( R� t appendR� R9 R� ( RN R� R� R� ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyR� < s
'c C sb | | d | j k r^ | j j d | j | | d � t d j | j | | d � � � n d S( Nt sha1sK rejecting download due to manifest SHA1 mismatch (expected: %s, actual: %s)sJ downloaded file {0} appears to be corrupt (expected SHA1: {0}, actual: {1}( t hexdigestR? t errort RuntimeErrorRZ ( RN R� R� RJ ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt __check_part_sha1C s N( R� R� R RI R� R R R� R� R� R� R� R� R� ( ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyR� � s$
c C s^ t j j | � s- t d j | | � � � n t j j | � sZ t d j | | � � � n d S( Ns {0} file '{1}' does not exists {0} file '{1}' is not a file( R= RC RX R RZ t isfile( R� t filetype( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyRF N s c C s8 t j d d t j d t j �} | j | � d j � S( Nt opensslt x509s -fingerprints -nooutR^ t stdouti ( R R s -fingerprints -noout( t
subprocesst Popent PIPEt communicatet strip( t cert_contentt popen( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt _get_cert_fingerprintW s (, R� R� R� t os.pathR= Rp R R] R� t requestbuilderR R t requestbuilder.exceptionsR RL t euca2ools.bundle.manifestRc t euca2ools.bundle.utilt euca2ools.commands.argtypesR R R R t8 euca2ools.commands.bootstrap.describeservicecertificatesR t! euca2ools.commands.s3.checkbucketR t" euca2ools.commands.s3.createbucketR t euca2ools.commands.s3.getobjectR
t euca2ools.commands.s3.postobjectR t euca2ools.commands.s3.putobjectR t euca2ools.exceptionsR
Rg t objectR R� R� RF R ( ( ( sD /usr/lib/python2.7/site-packages/euca2ools/commands/bundle/mixins.pyt <module> s6 "� -rw
Mini Shell