Function Description
aes_decrypt(expr, key[, mode[, padding]]) Returns a decrypted value of `expr` using AES in `mode` with `padding`. Key lengths of 16, 24 and 32 bits are supported. Supported combinations of (`mode`, `padding`) are ('ECB', 'PKCS') and ('GCM', 'NONE'). The default mode is GCM.
aes_encrypt(expr, key[, mode[, padding]]) Returns an encrypted value of `expr` using AES in given `mode` with the specified `padding`. Key lengths of 16, 24 and 32 bits are supported. Supported combinations of (`mode`, `padding`) are ('ECB', 'PKCS') and ('GCM', 'NONE'). The default mode is GCM.
assert_true(expr) Throws an exception if `expr` is not true.
current_catalog() Returns the current catalog.
current_database() Returns the current database.
current_user() user name of current execution context.
input_file_block_length() Returns the length of the block being read, or -1 if not available.
input_file_block_start() Returns the start offset of the block being read, or -1 if not available.
input_file_name() Returns the name of the file being read, or empty string if not available.
java_method(class, method[, arg1[, arg2 ..]]) Calls a method with reflection.
monotonically_increasing_id() Returns monotonically increasing 64-bit integers. The generated ID is guaranteed to be monotonically increasing and unique, but not consecutive. The current implementation puts the partition ID in the upper 31 bits, and the lower 33 bits represent the record number within each partition. The assumption is that the data frame has less than 1 billion partitions, and each partition has less than 8 billion records. The function is non-deterministic because its result depends on partition IDs.
reflect(class, method[, arg1[, arg2 ..]]) Calls a method with reflection.
spark_partition_id() Returns the current partition id.
typeof(expr) Return DDL-formatted type string for the data type of the input.
uuid() Returns an universally unique identifier (UUID) string. The value is returned as a canonical UUID 36-character string.
version() Returns the Spark version. The string contains 2 fields, the first being a release version and the second being a git revision.