Search Results - Mathematics of computing Probability and statistics Stochastic processes

Stochastic Processes with Expected Stopping Time by Chatterjee, Krishnendu, Doyen, Laurent

“…Markov chains are the de facto finite-state model for stochastic dynamical systems, and Markov decision processes (MDPs…”
Get full text

PolyGym: Polyhedral Optimizations as an Environment for Reinforcement Learning by Brauckmann, Alexander, Goens, Andres, Castrillon, Jeronimo

“… In this paper, we propose a shape-agnostic formulation for the space of legal transformations in the polyhedral model as a Markov Decision Process (MDP…”
Get full text

An Algorithm for Random Fractal Filling of Space by Shier, John, Bourke, Paul

“…Computational experiments with a simple algorithm show that it is possible to fill any spatial region with a random fractalization of any shape, with a…”
Get full text

Efficient Local Computation of Differential Bisimulations via Coupling and Up-to Methods by Bacci, Giorgio, Bacci, Giovanni, Larsen, Kim G., Tribastone, Mirco, Tschaikowski, Max, Vandin, Andrea

“…We introduce polynomial couplings, a generalization of probabilistic couplings, to develop an algorithm for the computation of equivalence relations which can…”
Get full text

Reliability of Run-Time Quality-of-Service Evaluation Using Parametric Model Checking by Guoxin Su, Rosenblum, David S., Tamburrelli, Giordano

“…Run-time Quality-of-Service (QoS) assurance is crucial for business-critical systems. Complex behavioral performance metrics (PMs) are useful but often…”
Get full text

Randomness meets feedback: Stochastic implementation of logistic map dynamical system by Zhiheng Wang, Saraf, Naman, Bazargan, Kia, Scheel, Arnd

“…Stochastic Computing (SC) is a digital computation approach that operates on random bit streams to perform complex tasks with much smaller hardware footprints compared to conventional approaches that employ binary radix…”
Get full text

Using quantitative analysis to implement autonomic IT systems by Calinescu, Radu, Kwiatkowska, Marta

“…The software underpinning today's IT systems needs to adapt dynamically and predictably to rapid changes in system workload, environment and objectives. We…”
Get full text

Buffer Insertion for Bridges and Optimal Buffer Sizing for Communication Sub-System of Systems-on-Chip by Kallakuri, Sankalp S., Doboli, Alex, Feinberg, Eugene A.

“…We have presented an optimal buffer sizing and buffer insertion methodology which uses stochastic models of the architecture and Continuous Time Markov Decision Processes CTMDPs…”
Get full text

Constructing compact causal mathematical models for complex dynamics by Xue, Yuankun, Bogdan, Paul

“… the statistics of the magnitude increments and the inter-event times of stochastic processes. We derive…”
Get full text

Reinforcement learning for model building and variance-penalized control by Gosavi, Abhijit

“…Reinforcement learning (RL) is a simulation-based technique to solve Markov decision problems or processes (MDPs…”
Get full text

Battery-aware power management based on Markovian decision processes by Rong, Peng, Pedram, Massoud

“… The model, which is based on the theories of continuous-time Markovian decision processes and stochastic networks, captures two important characteristics of today's rechargeable battery cells, i.e…”
Get full text

A Stochastic Technique to Obtain Training Data for Word Segmentation by Fukuda, Takuya, Miura, Takao

“… In this work, we discuss how to obtain pseudo test corpus based on Markov process Monte Carlo Method (MCMC…”
Get full text

Unpaired Kidney Exchange: Overcoming Double Coincidence of Wants without Money by Akbarpour, Mohammad, Combe, Julien, He, Yinghua, Hiller, Victor, Shimer, Robert, Tercieux, Olivier

“…We propose a new matching algorithm -- Unpaired kidney exchange -- to tackle the problem of double coincidence of wants without using money. The fundamental…”
Get full text

Dynamic power management of complex systems using generalized stochastic Petri nets by Qiu, Qinru, Wu, Qing, Pedram, Massoud

“… We model a power-managed distributed computing system as a controllable Generalized Stochastic Petri Net (GSPN) with cost…”
Get full text

Importance sampling in Markovian settings by Sandmann, Werner

“…Rare event simulation for stochastic models of complex systems is still a great challenge even for Markovian models…”
Get full text

The use of hyper-hidden markov models in wireless channel simulation by Boadi, Antonia Marie

“…The transmission of multimedia over satellite, cellular or mobile wireless networks introduces impairments which degrade signal quality. This thesis proposes a…”
Get full text

Risk and information in the estimation of hidden Markov models by Ramezani, Vahid R., Marcus, Steven I., Fu, Michael

“… Product estimators are introduced as a generalization of Maximum A Posteriori Probability (MAP…”
Get full text

Parametric inference for generalized semi-Markov processes by Damerdji, Halem

Get full text

Hierarchical Adaptive Dynamic Power Management by Ren, Zhiyuan, Krogh, Bruce H., Marculescu, Radu

“…) under nonstationary service requests. We model the nonstationary arrival process of service requests as a Markov-modulated stochastic process in which the stochastic process for each modulation state models a particular stationary mode…”
Get full text

Data Driven Design of an ANN/HMM System for On-line Unconstrained Handwritten Character Recognition by Li, Haifeng

“…This paper is dedicated to data driven design method for a hybrid ANN / HMM based handwriting recognition system. On one hand, a data driven designed neural…”
Get full text