We define two new classes of stochastic processes, called tempered fractional Levy process of the first and second kinds (TFLP and TFLP II, respectively). TFLP and TFLP II make up very broad finite-variance, generally non-Gaussian families of transient anomalous diffusion models that are constructed by exponentially tempering the power law kernel in the moving average representation of a fractional Levy process. Accordingly, the increment processes of TFLP and TFLP II display semi-long range dependence. We establish the sample path properties of TFLP and TFLP II. We further use a flexible framework of tempered fractional derivatives and integrals to develop the theory of stochastic integration with respect to TFLP and TFLP II, which may not be semimartingales depending on the value of the memory parameter and choice of marginal distribution.