||2 years ago|
|docs||2 years ago|
|testing||3 years ago|
|vaultpass||3 years ago|
|.gitignore||3 years ago|
|LICENSE||3 years ago|
|TODO||3 years ago|
|example.vaultpass.xml||3 years ago|
|pass.py||3 years ago|
VaultPass User Manual
- Known Incompatibilities with Pass
.extensions/COMMAND.bash, and Default Subcommands
- find/search Subcommand Searching
- Environment Variables
- Vault Paths Don’t Match VaultPass' Paths
- Unable to specify
- Deleting Secrets in KV2
- Submitting a Bug Report/Feature Request
What is Vault?
Vault by HashiCorp is a "secrets manager" - it securely protects various secrets with a very robust system of authentication and authorization.
What is Pass?
Pass ("The standard Unix password manager") is a password manager written entirely in bash and backed by GPG. It’s fairly barebones in terms of technology but does a decent enough job.
What is VaultPass?
VaultPass attempts to bridge the gap between the two. It aims to be a drop-in replacement for the pass CLI utility via subcommands and other operations, but obviously with Vault as a backend instead of GPG-encrypted flatfile hierarchy.
Obviously since the backends are vastly different, total parity is going to be impossible but I try to get it pretty close. Important deviations are documented below.
Unlike Pass, PassVault requires a persistent configuration. At the very least, the authentication method needs to be specified.
The default location for the configuration file is
~/.config/vaultpass.xml. It’s an XML document formatted with the
The XML prolog, specifying the character encoding of the document and XML version.
The root element (
vaultpass). This element contains attributes describing parsing/validation specifics as well, such as the namespace definitions and schema location.
serverelement. This element is a container for connection and management of the Vault server and is required (even though it may not have any children). This consists of:
urielement. It should be the same as the base URL for your Vault server. If not specified, the default is to first check for a
VAULT_ADDRenvironment variable and, if not found, to use
An unseal element, which can be used to (attempt to) automatically unseal the server if it is sealed. This isn’t required, but can assist in automatic operation. One of either:
unseal, the unseal key shard (a Base64 string), or
unsealGpg, the unseal key shard encrypted with GPG. See the section on GPG-Encrypted Elements.
A required authentication directive which specifies how we should authenticate to Vault. It should be comprised of one of either:
auth(see Auth section below), or
authGpg, an Auth config snippet encrypted with GPG. See the section on GPG-Encrypted Elements.
If you would like to initialize Vault with VaultPass, use a self-enclosed Token auth stanza. It will automatically be replaced once a root token is generated.
Let’s look at an example configuration.
<?xml version="1.0" encoding="UTF-8" ?> <vaultpass xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="https://git.square-r00t.net/VaultPass/" xsi:schemaLocation="https://git.square-r00t.net/VaultPass/ http://schema.xml.r00t2.io/projects/vaultpass.xsd"> <server> <uri>http://localhost:8200/</uri> <unseal>YOUR_UNSEAL_SHARD</unseal> </server> <auth> <token/> </auth> <mounts> <mount type="kv1">secret_legacy</mount> <mount type="kv2">secret</mount> <mount type="cubbyhole">cubbyhole</mount> </mounts> </vaultpass>
In the above, we can see that it would use the Vault server at
http://localhost:8200/ using whatever token is either
VAULT_TOKEN environment variable or, if empty, the
~/.vault-token file. Because an unseal shard was
provided, it will be able to attempt to automatically unseal the Vault (assuming its shard will complete the threshold
needed). Because we specify mounts, we do not need permissions in Vault to list
/sys/mounts (but if our token has
access to do so per its policy, then any automatically discovered will be added).
Vault itself supports a large number of authentication methods. However, in the interest if maintainability, this project has limited support to only the most common authentication methods. More authentication methods may be added in the future upon request.
|All of these (except for Token) require configuration in Vault first. Configuration of those authentication methods is out of scope for this document and project. Please ensure that your authentication works as expected in the Vault CLI utility or via the Vault API first before submitting a bug report in VaultPass.|
AppRole takes two required children elements:
appRole(the container element)
role, the AppRole’s RoleID, and
secret, the AppRole’s SecretID.
<!-- SNIP --> <auth> <appRole> <role>my-role</role> <secret>37b74931-c4cd-d49a-9246-ccc62d682a25</secret> </appRole> </auth> <!-- SNIP -->
LDAP takes two required children elements and one optional child element:
ldap(the container element)
username, the username (as according to the
userattrsettings in the configuration)
password, the password for the account object.
mountPoint, the mount point for the LDAP authentication in Vault. The default, if not provided, is
<!-- SNIP --> <auth> <ldap> <username>mitchellh</username> <password>MyPassword1</password> <mountPoint>ldap</mountPoint> </ldap> </auth> <!-- SNIP -->
Token auth is the most basic supported authentication in Vault and can be used without any further configuration.
It consists of, at its most basic (and "automagic") configuration, a single element — but this can be configured more in-depth/explicitly.
token(the container element)
The token itself or content/source of the token.
It has one optional attribute:
source.. It can be one of the following:
env:MY_TOKEN_VAR, in which environmental token
MY_TOKEN_VARwill be sourced.
A filesystem path, in which the file is assumed to contain the token (and ONLY the token).
To determine the behaviour of how this behaves, please refer to the below table.
token contained in tags, no
The specified token will be used and no automatic detection will occur.
token contained in tags,
Same as 3;
If the Vault instance is not initialized and a
vaultpass init is called, the configuration file will be updated to
use token auth, populated with the new root token, and populated with the new unseal shard. (The previous configuration
file will be backed up first!).
<!-- SNIP --> <auth> <!-- "Automagic" (#1). First $VAULT_TOKEN environment variable is checked, then ~/.vault-token is checked. --> <token/> <!-- Source is considered the only place to fetch token from (#2). --> <!-- This would check the environment variable $SOMEVAR --> <!-- <token source="env:SOMEVAR"/> --> <!-- This would use the contents of ~/.vault-token.alt --> <!-- <token source="~/.vault-token.alt"/> --> <!-- Token explicitly given is the only one used. --> <!-- <token>s.Lp4ix1CKBtJOfA46Ks4b4cs6</token> --> <!-- Token explicitly given is the only one used; source attribute is ignored. --> <!-- <token source="env:THIS_IS_IGNORED">s.Lp4ix1CKBtJOfA46Ks4b4cs6</token> --> </auth> <!-- SNIP -->
Vault’s userpass authentication method must be configured beforehand, but it’s a relatively simple configuration.
VaultPass user/password authentication takes two required children elements and one optional element.
userpass(the container element)
username, the username of the account.
password, the password for the account.
mountPoint, the mount point for the auth. If not specified, the default is
<!-- SNIP --> <auth> <userpass> <username>mitchellh</username> <password>foo</password> <mountPoint>userpass</mountPoint> </userpass> </auth> <!-- SNIP -->
VaultPass has the ability to automatically detect (some) mounts and their paths.
So why, then, should you specify them in the configuration file? Simple: because you might not have permission to list them! Even if you can see the mounts in the web UI that you have permission to, that doesn’t guarantee that they’re accessible/viewable via the API (which is how VaultPass, and even the upstream Vault binary client, operates). So by specifying them in the configuration file, you’re able to "bootstrap" the process.
mounts  container contains one or more
mount child elements, with the name of the
mountpoint as the content.
mount element has one optional attribute,
type , which can be one of:
More mount types may be added upon popular demand and technical feasability.
Understandably, in order to have a persistent configuration, that means storing on disk. That also means that they need
to be able to be accessed with no or minimal user interruption. Pass used GPG natively, so it didn’t have an issue with
this; since gpg-agent is typically
spawned on first use of a GPG homedir (usually
~/.gnupg/ by default)
and keeps an authenticated session open for 10 minutes
To get around needing to store plaintext credentials on-disk in any form, VaultPass has
elements. These elements are of the same composition (described below) and allow you to use GPG to
encrypt that sensitive information.
While this does increase security, it breaks compatibility with other XML parsers - they won’t be able to decrypt and parse the encrypted snippet unless explicitly coded to do so.
*Gpg elements (
unsealGpg) have the same structure:
authGpg, the container element.
The path to the encrypted file as the contained text.
It has one optional attribute,
gpgHome  — the GPG home directory to use. If not specified,
VaultPass will first check the
GNUPGHOME environment variable. If that isn’t defined, we’ll default to
~/.gnupg/ (or whatever the compiled-in default is).
The contents of the encrypted file should match the unencrypted XML content it’s replacing.
Note that if you use namespaces in your
Let’s look at an example of GPG-encrypted elements.
GPG-Encrypted Elements Example
<?xml version="1.0" encoding="UTF-8" ?> <vaultpass xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="https://git.square-r00t.net/VaultPass/" xsi:schemaLocation="https://git.square-r00t.net/VaultPass/ http://schema.xml.r00t2.io/projects/vaultpass.xsd"> <server> <uri>http://localhost:8200/</uri> <unsealGpg gpgHome="~/.gnupg">~/.private/vaultpass/unseal.asc</unsealGpg> </server> <authGpg gpgHome="~/.gnupg">~/.private/vaultpass/auth.gpg</unsealGpg> </vaultpass>
As shown, it supports both ASCII-Armored and Binary encryption formats.
-----BEGIN PGP MESSAGE----- hQIMA7QuYg9nGdZdAQ//eHvEZ7vpLvygM2ofIiT2uW7cWYQaYm/09li7s0+0ZqTu hNki7oIQ1Ip+k6ds45eEXPG6hXwZ7+mtIDG8VcYpo0PdwpvcJ9qqAgvnFAynvjgH pRkeIw4VUfGxxhs8oZMvdrXuYtwzaXIhn0UuZv+cIS1Jj6IfG0xSpRvd+M0MW+Wk IWSIyUcY6fkP7MFEiId7sQwm6htHXJDqiVAmwn4lqk2CnIhtsTd5HUyRzGg5gZs+ sFAssa7QjoBKJMkTDVH4EIC4GcgNtTB/rg7XBoX1k36CHZAwB/boZ5arMYswwkYp VFv9At13vkkRMf23bb7siq7U0Vbvs0PGsFJS/1ivS1IyzFGFZGHaTz7ndk2q2iyY tMjMe+z+i2VAGvtfdE7H4K4TrqrM9OZ81vyJkEjRBrkSfR9sWOgv5yBFDvoeVkZl k1gRXLkrF/7eZn8vD17oOew/zr+um7s/rTtLp5GEknOsKzb1NOMBHP44dXdxNreT HdRlNDLgOp2KffXgNSm/A026tMSA0nf0kpJmR1yLjucKPoy6wVrTMh+sLNubgxmZ BCz64myu8dfWtHQfPSis1kjrs15mfQoOu9Cl9st8gTs50sKWTa+dGdajZEcz8rcX OMBLwiTQodP/0uRHf8YofIFk86QXbYALd4WsC/KvDQBiaz8HRcfkccDQCHQvdLrS wEkBuhCZj1OqUnTXg0qggMD0Hp2pO0CqD4uZ3RHvIt49W+7oUr22Y4VarRNeP06x JhYC3Sr0RXv/Vi21DMiUUUAXYeYKP82HpP0zSZhCcwVZZje1dXwq85SH04u9pT+n f2JqgATxmAaepQZCANxAluknfSluuCBi0hmhagYY2IsgKmJcSsksm0AWfGyzgoeV ZypDlE3MuERVLJSDBjZtfnScy3CeTWWj5vw7Nfm5XEqOuIIbZaTV/qb6i6y4rc6k Yx5xYKHeuXJGbrQdVJemcXyDIV5tDw5RtLpO57EwL+uEYgSbN9rO/N2B83QjB7D5 lCmbJtQcjxG/eJ/SrB2oS47YdEKRy+cH0Xx+ =scGv -----END PGP MESSAGE-----
<unseal xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="https://git.square-r00t.net/VaultPass/" xsi:schemaLocation="https://git.square-r00t.net/VaultPass/ http://schema.xml.r00t2.io/projects/vaultpass.xsd">1fs1tV46ebb6awF6edtuzsoEawZlBARFp5rSaED+EJI=</unseal>
<auth xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="https://git.square-r00t.net/VaultPass/" xsi:schemaLocation="https://git.square-r00t.net/VaultPass/ http://schema.xml.r00t2.io/projects/vaultpass.xsd"> <token>s.Lp4ix1CKBtJOfA46Ks4b4cs6</token> </auth>
Known Incompatibilities with Pass
.extensions/COMMAND.bash, and Default Subcommands
Per the Pass man page:
If no COMMAND is specified, COMMAND defaults to either show or ls, depending on the type of specifier in ARGS. Alternatively, if PASSWORD_STORE_ENABLE_EXTENSIONS is set to "true", and the file .extensions/COMMAND.bash exists inside the password store and is executable, then it is sourced into the environment, passing any arguments and environment variables. Extensions existing in a system-wide directory, only installable by the administrator, are always enabled.
Due to this being Python, we lose some of this compatibility. It may be possible to add this functionality in the future, but it’s lower priority currently.
Similarly, we cannot set a default subcommand as of yet in Python via
argparse (the library that VaultPass uses to
parse command-line arguments).
You can set an alias in your
~/.bashrc that will:
Provide a direct command for
Specify default options for a command
Via the following:
# ... # 1 alias pass='vaultpass show' # 2 alias lpass='vaultpass ls' # 3 alias vaultpass='vaultpass -c ~/.config/alternate.vaultpass.xml'
To use the non-aliased command in Bash, you can either invoke the full path:
/usr/local/bin/vaultpass edit path/to/secret
Or, alternatively, prefix with a backslash:
\vaultpass edit path/to/secret
Finally, you can always use VaultPass by specifying the subcommand and disregard aliases entirely.
find/search Subcommand Searching
What is supported, however, is regular expressions' ("regex") match patterns.
If you haven’t used regexes before, here are some helpful starters/tools:
Regular expressions are MUCH more powerful than the
find globbing language, but do have a slight learning curve. You
will be thankful to learn their syntax, however, as they are very widely applicable.
Pass (and to a slightly lesser extent, Vault) relies almost entirely/exclusively upon environment variables for configuration. VaultPass does not.
Relying entirely on environment variables for configuration is dumb, so I don’t do on that. All persistent configuration can be either specified in the configuration file or can be overridden by flags/switches to subcommands. Some configuration directives/behaviour may be overridden by environment variables where supported by Vault/Pass upstream configuration.
Vault Paths Don’t Match VaultPass' Paths
Pass and Vault have fundamentally different storage ideas. Pass secrets/passwords are, once decrypted, just plaintext blobs. Vault, on the other hand, uses a key/value type of storage. As a result, this means two things:
The last item in a path in VaultPass is the key name (e.g. the path
foo/bar/bazin VaultPass would be a Vault path of
foo/bar, which would then have a key named
line-numbersub-argument is completely irrelevant for things like copying to the clipboard and generating a QR code (e.g. as in
pass show --clip=line-number).
None, aside from not using the
line-number sub-argument since it’s no longer relevant. (You’ll get an error if you
Unable to specify
See above (Vault Paths Don’t Match VaultPass' Paths).
Deleting Secrets in KV2
In Pass, because it doesn’t have versioning (unless you’re using git with your Pass instance). Vault’s
however, does have versioning. As a result, once a secret is "deleted", it can still be recovered via
undelete method. If you are
deleting a secret for security reasons, you may want to destroy it instead. VaultPass' delete method uses a delete
rather than a destroy.
VaultPass has a new subcommand,
destroy, which will remove versioned secrets permanently. Use with caution,
obviously. If called on a non-KV2 mount’s path, it will be the same as the
Submitting a Bug Report/Feature Request
Please use my bugtracker.