On the impossibility of non trivial accuracy under fairness constraints. One of the main concerns about fairness in machine learning (ML) is that, in order to achieve it, one may have to trade off some accuracy. To overcome this issue, Hardt et al. proposed the notion of equality of opportunity (EO), which is compatible with maximal accuracy when the target label is deterministic with respect to the input features. In the probabilistic case, however, the issue is more complicated It has been shown that under differential privacy constraints, there are data sources for which EO can only be achieved at the total detriment of accuracy, in the sense that a classifier that satisfies EO cannot be more accurate than a trivial (i.e., constant) classifier. In our paper we strengthen this result by removing the privacy constraint. Namely, we show that for certain data sources, the most accurate classifier that satisfies EO is a trivial classifier. Furthermore, we study the trade off between accuracy and EO loss (opportunity difference), and provide a sufficient condition on the data source under which EO and non trivial accuracy are compatible.


Conformal ( si, t) Derivations on Lie conformal superalgebras. In this paper, we focus on the ( si, t) derivation theory of Lie conformal superalgebras. Firstly, we study the fundamental properties of conformal ( si, t) derivations. Secondly, we mainly research the interiors of conformal G derivations. Finally, we discuss the relationships between the conformal ( si, t) derivations and some generalized conformal derivations of Lie conformal superalgebras.


Deep Learning Based 3D Point Cloud Regression for Estimating Forest Biomass. Knowledge of forest biomass stocks and their development is important for implementing effective climate change mitigation measures. It is needed for studying the processes driving af , re , and deforestation and is a prerequisite for carbon accounting. Remote sensing using airborne LiDAR can be used to measure vegetation biomass at large scale. We present deep learning systems for predicting wood volume, above ground biomass (AGB), and subsequently carbon directly from 3D LiDAR point cloud data. We devise different neural network architectures for point cloud regression and evaluate them on remote sensing data of areas for which AGB estimates have been obtained from field measurements in a national forest inventory. Our adaptation of Minkowski convolutional neural networks for regression gave the best results. The deep neural networks produced significantly more accurate wood volume, AGB, and carbon estimates compared to state of the art approaches operating on basic statistics of the point clouds, and we expect this finding to have a strong impact on LiDAR based analyses of terrestrial ecosystem dynamics.


Optimal Estimates on the Propagation of Reactions with Fractional Diffusion. We study the reaction fractional diffusion equation u t ( Delta) s u f(u) with ignition and monostable reactions f , and s in(0,1) . We obtain the first optimal bounds on the propagation of front like solutions in the cases where no traveling fronts exist. Our results cover most of these cases, and also apply to propagation from localized initial data.


Infinite time concentration in Aggregation Diffusion equations with a given potential. Typically, aggregation diffusion is modeled by parabolic equations that combine linear or nonlinear diffusion with a Fokker Planck convection term. Under very general suitable assumptions, we prove that radial solutions of the evolution process converge asymptotically in time towards a stationary state representing the balance between the two effects. Our parabolic system is the gradient flow of an energy functional, and in fact we show that the stationary states are minimizers of a relaxed energy. Here, we study radial solutions of an aggregation diffusion model that combines nonlinear fast diffusion with a convection term driven by the gradient of a potential, both in balls and the whole space. We show that, depending on the exponent of fast diffusion and the potential, the steady state is given by the sum of an explicit integrable function, plus a Dirac delta at the origin containing the rest of the mass of the initial datum. Furthermore, it is a global minimizer of the relaxed energy. This splitting phenomenon is an uncommon example of blow up in infinite time.


Directionality Reinforcement Learning to Operate Multi Agent System without Communication. This paper establishes directionality reinforcement learning (DRL) technique to propose the complete decentralized multi agent reinforcement learning method which can achieve cooperation based on each agent's learning no communication and no observation. Concretely, DRL adds the direction "agents have to learn to reach the farthest goal among reachable ones" to learning agents to operate the agents cooperatively. Furthermore, to investigate the effectiveness of the DRL, this paper compare Q learning agent with DRL with previous learning agent in maze problems. Experimental results derive that (1) DRL performs better than the previous method in terms of the spending time, (2) the direction makes agents learn yielding action for others, and (3) DRL suggests achieving multiagent learning with few costs for any number of agents.


Linking disjoint axis parallel segments into a simple polygon is hard too. Deciding whether a family of disjoint axis parallel line segments in the plane can be linked into a simple polygon (or a simple polygonal chain) by adding segments between their endpoints is NP hard.


Quasinormal mode theory for nanoscale electromagnetism with quantum surface responses. We report a self consistent quasinormal mode theory for nanometer scale electromagnetism where the possible nonlocal and quantum effects are treated through quantum surface responses. With Feibelman's frequency dependent textit d parameters to describe the quantum surface responses, we formulate the source free Maxwell's equations into a generalized linear eigenvalue problem to define the quasinormal modes. We then construct an orthonormal relation for the modes and consequently unlock the powerful toolbox of modal analysis. The orthonormal relation is validated by the reconstruction of the full numerical results through modal contributions. Significant changes in the landscape of the modes are observed due to the incorporation of the quantum surface responses for a number of nanostructures. Our semi analytical modal analysis enables transparent physical interpretation of the spontaneous emission enhancement of a dipolar emitter as well as the near field and far field responses of planewave excitations in the nanostructures.


Reusing Combinatorial Structure Faster Iterative Projections over Submodular Base Polytopes. Optimization algorithms such as projected Newton's method, FISTA, mirror descent and its variants enjoy near optimal regret bounds and convergence rates, but suffer from a computational bottleneck of computing "projections'' in potentially each iteration (e.g., O(T 1 2 ) regret of online mirror descent). On the other hand, conditional gradient variants solve a linear optimization in each iteration, but result in suboptimal rates (e.g., O(T 3 4 ) regret of online Frank Wolfe). Motivated by this trade off in runtime v s convergence rates, we consider iterative projections of close by points over widely prevalent submodular base polytopes B(f) . We develop a toolkit to speed up the computation of projections using both discrete and continuous perspectives. We subsequently adapt the away step Frank Wolfe algorithm to use this information and enable early termination. For the special case of cardinality based submodular polytopes, we improve the runtime of computing certain Bregman projections by a factor of Omega(n log(n)) . Our theoretical results show orders of magnitude reduction in runtime in preliminary computational experiments.


Universal Radial Approximation in Spaces of Analytic Functions. Recently, Charpentier showed that there exist holomorphic functions f in the unit disk such that, for any proper compact subset K of the unit circle, any continuous function phi on K and any compact subset L of the unit disk, there exists an increasing sequence (r n) n in mathbb N subseteq 0,1) converging to 1 such that f(r n( zeta z) z) phi( zeta) to0 as n to infty uniformly for zeta in K and z in L . In this paper, we give analogues of this result for the Hardy spaces H p( mathbb D ),1 leq p infty . In particular, our main result implies that, if we fix a compact subset K of the unit circle with zero arc length measure, then there exist functions in H p( mathbb D ) whose radial limits can approximate every continuous function on K . We give similar results for the Bergman and Dirichlet spaces.


Representation range needs for 16 bit neural network training. Deep learning has grown rapidly thanks to its state of the art performance across a wide range of real world applications. While neural networks have been trained using IEEE 754 binary32 arithmetic, the rapid growth of computational demands in deep learning has boosted interest in faster, low precision training. Mixed precision training that combines IEEE 754 binary16 with IEEE 754 binary32 has been tried, and other 16 bit formats, for example Google's bfloat16, have become popular. In floating point arithmetic there is a tradeoff between precision and representation range as the number of exponent bits changes denormal numbers extend the representation range. This raises questions of how much exponent range is needed, of whether there is a format between binary16 (5 exponent bits) and bfloat16 (8 exponent bits) that works better than either of them, and whether or not denormals are necessary. In the current paper we study the need for denormal numbers for mixed precision training, and we propose a 1 6 9 format, i.e., 6 bit exponent and 9 bit explicit mantissa, that offers a better range precision tradeoff. We show that 1 6 9 mixed precision training is able to speed up training on hardware that incurs a performance slowdown on denormal operations or eliminates the need for denormal numbers altogether. And, for a number of fully connected and convolutional neural networks in computer vision and natural language processing, 1 6 9 achieves numerical parity to standard mixed precision.


On a reformulation of Navier Stokes equations based on Helmholtz Hodge decomposition. The proposal for a new formulation of the Navier Stokes equations is based on a Helmholtz Hodge decomposition where all the terms corresponding to the physical phenomena are written as the sum of a divergence free term and another curl free term. These transformations are founded on the bases of discrete mechanics, an alternative approach to the mechanics of continuous media, where conservation of the acceleration on a segment replaces that of the momentum on a volume. The equation of motion thus becomes a law of conservation of total mechanical energy per volume unit where the conservation of mass is no longer necessarily an additional law. The new formulation of the Navier Stokes equations recovers the properties of the discrete approach without altering those of its initial form the solutions of the classical form are also those of the proposed formulation. Writing inertial terms in two components resulting from the Helmholtz Hodge decomposition gives the equation of motion new properties when differential operators are applied to it directly.


Optimal Control Policies to Address the Pandemic Health Economy Dilemma. Non pharmaceutical interventions (NPIs) are effective measures to contain a pandemic. Yet, such control measures commonly have a negative effect on the economy. Here, we propose a macro level approach to support resolving this Health Economy Dilemma (HED). First, an extension to the well known SEIR model is suggested which includes an economy model. Second, a bi objective optimization problem is defined to study optimal control policies in view of the HED problem. Next, several multi objective evolutionary algorithms are applied to perform a study on the health economy performance trade offs that are inherent to the obtained optimal policies. Finally, the results from the applied algorithms are compared to select a preferred algorithm for future studies. As expected, for the proposed models and strategies, a clear conflict between the health and economy performances is found. Furthermore, the results suggest that the guided usage of NPIs is preferable as compared to refraining from employing such strategies at all. This study contributes to pandemic modeling and simulation by providing a novel concept that elaborates on integrating economic aspects while exploring the optimal moment to enable NPIs.


Functional calculus and quantization commutes with reduction for Toeplitz operators on CR manifolds. Given a CR manifold with non degenerate Levi form, we show that the operators of the functional calculus for Toeplitz operators are complex Fourier integral operators of Szeg H o type. As an application, we establish semi classical spectral dimensions for Toeplitz operators. We then consider a CR manifold with a compact Lie group action G and we establish quantization commutes with reduction for Toeplitz operators. Moreover, we also compute semi classical spectral dimensions for G invariant Toeplitz operators.


Estimating Redundancy in Clinical Text. The current mode of use of Electronic Health Record (EHR) elicits text redundancy. Clinicians often populate new documents by duplicating existing notes, then updating accordingly. Data duplication can lead to a propagation of errors, inconsistencies and misreporting of care. Therefore, quantifying information redundancy can play an essential role in evaluating innovations that operate on clinical narratives. This work is a quantitative examination of information redundancy in EHR notes. We present and evaluate two strategies to measure redundancy an information theoretic approach and a lexicosyntactic and semantic model. We evaluate the measures by training large Transformer based language models using clinical text from a large openly available US based ICU dataset and a large multi site UK based Trust. By comparing the information theoretic content of the trained models with open domain language models, the language models trained using clinical text have shown 1.5x to 3x less efficient than open domain corpora. Manual evaluation shows a high correlation with lexicosyntactic and semantic redundancy, with averages 43 to 65 .


Twitter COMMs Detecting Climate, COVID, and Military Multimodal Misinformation. Detecting out of context media, such as "mis captioned" images on Twitter, is a relevant problem, especially in domains of high public significance. In this work we aim to develop defenses against such misinformation for the topics of Climate Change, COVID 19, and Military Vehicles. We first present a large scale multimodal dataset with over 884k tweets relevant to these topics. Next, we propose a detection method, based on the state of the art CLIP model, that leverages automatically generated hard image text mismatches. While this approach works well on our automatically constructed out of context tweets, we aim to validate its usefulness on data representative of the real world. Thus, we test it on a set of human generated fakes created by mimicking in the wild misinformation. We achieve an 11 detection improvement in a high precision regime over a strong baseline. Finally, we share insights about our best model design and analyze the challenges of this emerging threat.


A p adaptive, implicit explicit mixed finite element method for reaction diffusion problems. A new class of implicit explicit (IMEX) methods combined with a p adaptive mixed finite element formulation is proposed to simulate the diffusion of reacting species. Hierarchical polynomial functions are used to construct an H( mathrm Div ) conforming base for the flux vectors, and a non conforming L 2 base for the mass concentration of the species. The mixed formulation captures the distinct nonlinearities associated with the constitutive flux equations and the reaction terms. The IMEX method conveniently treats these two sources of nonlinearity implicitly and explicitly, respectively, within a single time stepping framework. The combination of the p adaptive mixed formulation and the IMEX method delivers a robust and efficient algorithm. The proposed methods eliminate the coupled effect of mesh size and time step on the algorithmic stability. A residual based a posteriori error estimate that provides an upper bound of the natural error norm is derived. The availability of such estimate which can be obtained with minimal computational effort and the hierarchical construction of the finite element spaces allow for the formulation of an efficient p adaptive algorithm. A series of numerical examples demonstrate the performance of the approach. It is shown that the method with the p adaptive strategy accurately solves problems involving travelling waves, and those with discontinuities and singularities. The flexibility of the formulation is also illustrated via selected applications in pattern formation and electrophysiology.


Improving Classifier Training Efficiency for Automatic Cyberbullying Detection with Feature Density. We study the effectiveness of Feature Density (FD) using different linguistically backed feature preprocessing methods in order to estimate dataset complexity, which in turn is used to comparatively estimate the potential performance of machine learning (ML) classifiers prior to any training. We hypothesise that estimating dataset complexity allows for the reduction of the number of required experiments iterations. This way we can optimize the resource intensive training of ML models which is becoming a serious issue due to the increases in available dataset sizes and the ever rising popularity of models based on Deep Neural Networks (DNN). The problem of constantly increasing needs for more powerful computational resources is also affecting the environment due to alarmingly growing amount of CO2 emissions caused by training of large scale ML models. The research was conducted on multiple datasets, including popular datasets, such as Yelp business review dataset used for training typical sentiment analysis models, as well as more recent datasets trying to tackle the problem of cyberbullying, which, being a serious social problem, is also a much more sophisticated problem form the point of view of linguistic representation. We use cyberbullying datasets collected for multiple languages, namely English, Japanese and Polish. The difference in linguistic complexity of datasets allows us to additionally discuss the efficacy of linguistically backed word preprocessing.


On mean field super Brownian motions. The mean field stochastic partial differential equation (SPDE) corresponding to a mean field super Brownian motion (sBm) is obtained and studied. In this mean field sBm, the branching particle lifetime is allowed to depend upon the probability distribution of the sBm itself, producing an SPDE whose space time white noise coefficient has, in addition to the typical sBm square root, an extra factor that is a function of the probability law of the density of the mean field sBm. This novel mean field SPDE is thus motivated by population models where things like overcrowding and isolation can affect growth. A two step approximation method is employed to show existence for this SPDE under general conditions. Then, mild moment conditions are imposed to get uniqueness. Finally, smoothness of the SPDE solution is established under a further simplifying condition.


Enhanced Pub Sub Communications for Massive IoT Traffic with SARSA Reinforcement Learning. Sensors are being extensively deployed and are expected to expand at significant rates in the coming years. They typically generate a large volume of data on the internet of things (IoT) application areas like smart cities, intelligent traffic systems, smart grid, and e health. Cloud, edge and fog computing are potential and competitive strategies for collecting, processing, and distributing IoT data. However, cloud, edge, and fog based solutions need to tackle the distribution of a high volume of IoT data efficiently through constrained and limited resource network infrastructures. This paper addresses the issue of conveying a massive volume of IoT data through a network with limited communications resources (bandwidth) using a cognitive communications resource allocation based on Reinforcement Learning (RL) with SARSA algorithm. The proposed network infrastructure (PSIoTRL) uses a Publish Subscribe architecture to access massive and highly distributed IoT data. It is demonstrated that the PSIoTRL bandwidth allocation for buffer flushing based on SARSA enhances the IoT aggregator buffer occupation and network link utilization. The PSIoTRL dynamically adapts the IoT aggregator traffic flushing according to the Pub Sub topic's priority and network constraint requirements.


Reducing Data Complexity using Autoencoders with Class informed Loss Functions. Available data in machine learning applications is becoming increasingly complex, due to higher dimensionality and difficult classes. There exists a wide variety of approaches to measuring complexity of labeled data, according to class overlap, separability or boundary shapes, as well as group morphology. Many techniques can transform the data in order to find better features, but few focus on specifically reducing data complexity. Most data transformation methods mainly treat the dimensionality aspect, leaving aside the available information within class labels which can be useful when classes are somehow complex. This paper proposes an autoencoder based approach to complexity reduction, using class labels in order to inform the loss function about the adequacy of the generated variables. This leads to three different new feature learners, Scorer, Skaler and Slicer. They are based on Fisher's discriminant ratio, the Kullback Leibler divergence and least squares support vector machines, respectively. They can be applied as a preprocessing stage for a binary classification problem. A thorough experimentation across a collection of 27 datasets and a range of complexity and classification metrics shows that class informed autoencoders perform better than 4 other popular unsupervised feature extraction techniques, especially when the final objective is using the data for a classification task.


Global Calder ' o n Zygmund theory for parabolic p Laplacian system the case 1 p leq frac 2n n 2 . The aim of this paper is to establish global Calder ' o n Zygmund theory to parabolic p Laplacian system u t operatorname div ( nabla u p 2 nabla u) operatorname div ( F p 2 F) text in Omega times (0,T) subset mathbb R n 1 , proving that F in L q Rightarrow nabla u in L q, for any q max p, frac n(2 p) 2 and p 1 . Acerbi and Mingione cite Acerbi07 proved this estimate in the case p frac 2n n 2 . In this article we settle the case 1 p leq frac 2n n 2 . We also treat systems with discontinuous coefficients having small BMO (bounded mean oscillation) norm.


NEWRON A New Generalization of the Artificial Neuron to Enhance the Interpretability of Neural Networks. In this work, we formulate NEWRON a generalization of the McCulloch Pitts neuron structure. This new framework aims to explore additional desirable properties of artificial neurons. We show that some specializations of NEWRON allow the network to be interpretable with no change in their expressiveness. By just inspecting the models produced by our NEWRON based networks, we can understand the rules governing the task. Extensive experiments show that the quality of the generated models is better than traditional interpretable models and in line or better than standard neural networks.


On the Synchronization Power of Token Smart Contracts. Modern blockchains support a variety of distributed applications beyond cryptocurrencies, including smart contracts which let users execute arbitrary code in a distributed and decentralized fashion. Regardless of their intended application, blockchain platforms implicitly assume consensus for the correct execution of a smart contract, thus requiring that all transactions are totally ordered. It was only recently recognized that consensus is not necessary to prevent double spending in a cryptocurrency (Guerraoui et al., PODC'19), contrary to common belief. This result suggests that current implementations may be sacrificing efficiency and scalability because they synchronize transactions much more tightly than actually needed. In this work, we study the synchronization requirements of Ethereum's ERC20 token contract, one of the most widely adopted smart contacts. Namely, we model a smart contract token as a concurrent object and analyze its consensus number as a measure of synchronization power. We show that the richer set of methods supported by ERC20 tokens, compared to standard cryptocurrencies, results in strictly stronger synchronization requirements. More surprisingly, the synchronization power of ERC20 tokens depends on the object's state and can thus be modified by method invocations. To prove this result, we develop a dedicated framework to express how the object's state affects the needed synchronization level. Our findings indicate that ERC20 tokens, as well as other token standards, are more powerful and versatile than plain cryptocurrencies, and are subject to dynamic requirements. Developing specific synchronization protocols that exploit these dynamic requirements will pave the way towards more robust and scalable blockchain platforms.


Improved Bounds for the Oriented Radius of Mixed Multigraphs. A mixed multigraph is a multigraph which may contain both undirected and directed edges. An orientation of a mixed multigraph G is an assignment of exactly one direction to each undirected edge of G . A mixed multigraph G can be oriented to a strongly connected digraph if and only if G is bridgeless and strongly connected Boesch and Tindell, Am. Math. Mon., 1980 . For each r in mathbb N , let f(r) denote the smallest number such that any strongly connected bridgeless mixed multigraph with radius r can be oriented to a digraph of radius at most f(r) . We improve the current best upper bound of 4r 2 4r on f(r) Chung, Garey and Tarjan, Networks, 1985 to 1.5 r 2 r 1 . Our upper bound is tight upto a multiplicative factor of 1.5 since, forall r in mathbb N , there exists an undirected bridgeless graph of radius r such that every orientation of it has radius at least r 2 r Chv 'atal and Thomassen, J. Comb. Theory. Ser. B., 1978 . We prove a marginally better lower bound, f(r) geq r 2 3r 1 , for mixed multigraphs. While this marginal improvement does not help with asymptotic estimates, it clears a natural suspicion that, like undirected graphs, f(r) may be equal to r 2 r even for mixed multigraphs. En route, we show that if each edge of G lies in a cycle of length at most eta , then the oriented radius of G is at most 1.5 r eta . All our proofs are constructive and lend themselves to polynomial time algorithms.


Network Security Modeling using NetFlow Data Detecting Botnet attacks in IP Traffic. Cybersecurity, security monitoring of malicious events in IP traffic, is an important field largely unexplored by statisticians. Computer scientists have made significant contributions in this area using statistical anomaly detection and other supervised learning methods to detect specific malicious events. In this research, we investigate the detection of botnet command and control (C C) hosts in massive IP traffic. We use the NetFlow data, the industry standard for monitoring of IP traffic for exploratory analysis and extracting new features. Using statistical as well as deep learning models, we develop a statistical intrusion detection system (SIDS) to predict traffic traces identified with malicious attacks. Employing interpretative machine learning techniques, botnet traffic signatures are derived. These models successfully detected botnet C C hosts and compromised devices. The results were validated by matching predictions to existing blacklists of published malicious IP addresses.


Nonlocal approximations to anisotropic Sobolev norms. We obtain some nonlocal characterizations for a class of variable exponent Sobolev spaces arising in nonlinear elasticity, in the theory of electrorheological fluids as well as in image processing for the regions where the variable exponent p(x) reaches the value 1 .


LES3 Learning based Exact Set Similarity Search. Set similarity search is a problem of central interest to a wide variety of applications such as data cleaning and web search. Past approaches on set similarity search utilize either heavy indexing structures, incurring large search costs or indexes that produce large candidate sets. In this paper, we design a learning based exact set similarity search approach, LES3. Our approach first partitions sets into groups, and then utilizes a light weight bitmap like indexing structure, called token group matrix (TGM), to organize groups and prune out candidates given a query set. In order to optimize pruning using the TGM, we analytically investigate the optimal partitioning strategy under certain distributional assumptions. Using these results, we then design a learning based partitioning approach called L2P and an associated data representation encoding, PTR, to identify the partitions. We conduct extensive experiments on real and synthetic datasets to fully study LES3, establishing the effectiveness and superiority over other applicable approaches.


Nullstellensatz for relative existentially closed groups. We prove that in every variety of G groups, every G existentially closed element satisfies nullstellensatz for finite consistent systems of equations. This will generalize bf Theorem G of cite BMR1 . As a result we see that every pair of G existentially closed elements in an arbitrary variety of G groups generate the same quasi variety and if both of them are q omega compact, they are geometrically equivalent.


Distilling Knowledge via Knowledge Review. Knowledge distillation transfers knowledge from the teacher network to the student one, with the goal of greatly improving the performance of the student network. Previous methods mostly focus on proposing feature transformation and loss functions between the same level's features to improve the effectiveness. We differently study the factor of connection path cross levels between teacher and student networks, and reveal its great importance. For the first time in knowledge distillation, cross stage connection paths are proposed. Our new review mechanism is effective and structurally simple. Our finally designed nested and compact framework requires negligible computation overhead, and outperforms other methods on a variety of tasks. We apply our method to classification, object detection, and instance segmentation tasks. All of them witness significant student network performance improvement. Code is available at https github.com Jia Research Lab ReviewKD


Invariance, encodings, and generalization learning identity effects with neural networks. Often in language and other areas of cognition, whether two components of an object are identical or not determines if it is well formed. We call such constraints identity effects. When developing a system to learn well formedness from examples, it is easy enough to build in an identify effect. But can identity effects be learned from the data without explicit guidance? We provide a framework in which we can rigorously prove that algorithms satisfying simple criteria cannot make the correct inference. We then show that a broad class of learning algorithms including deep feedforward neural networks trained via gradient based algorithms (such as stochastic gradient descent or the Adam method) satisfy our criteria, dependent on the encoding of inputs. In some broader circumstances we are able to provide adversarial examples that the network necessarily classifies incorrectly. Finally, we demonstrate our theory with computational experiments in which we explore the effect of different input encodings on the ability of algorithms to generalize to novel inputs. This allows us to show similar effects to those predicted by theory for more realistic methods that violate some of the conditions of our theoretical results.


Neuromechanics based Deep Reinforcement Learning of Neurostimulation Control in FES cycling. Functional Electrical Stimulation (FES) can restore motion to a paralysed person's muscles. Yet, control stimulating many muscles to restore the practical function of entire limbs is an unsolved problem. Current neurostimulation engineering still relies on 20th Century control approaches and correspondingly shows only modest results that require daily tinkering to operate at all. Here, we present our state of the art Deep Reinforcement Learning (RL) developed for real time adaptive neurostimulation of paralysed legs for FES cycling. Core to our approach is the integration of a personalised neuromechanical component into our reinforcement learning framework that allows us to train the model efficiently without demanding extended training sessions with the patient and working out of the box. Our neuromechanical component includes merges musculoskeletal models of muscle and or tendon function and a multistate model of muscle fatigue, to render the neurostimulation responsive to a paraplegic's cyclist instantaneous muscle capacity. Our RL approach outperforms PID and Fuzzy Logic controllers in accuracy and performance. Crucially, our system learned to stimulate a cyclist's legs from ramping up speed at the start to maintaining a high cadence in steady state racing as the muscles fatigue. A part of our RL neurostimulation system has been successfully deployed at the Cybathlon 2020 bionic Olympics in the FES discipline with our paraplegic cyclist winning the Silver medal among 9 competing teams.


Some Basic Techniques allowing Petri Net Synthesis Complexity and Algorithmic Issues. In Petri net synthesis we ask whether a given transition system A can be implemented by a Petri net N . Depending on the level of accuracy, there are three ways how N can implement A an embedding, the least accurate implementation, preserves only the diversity of states of A a language simulation already preserves exactly the language of A a realization, the most accurate implementation, realizes the behavior of A exactly. However, whatever the sought implementation, a corresponding net does not always exist. In this case, it was suggested to modify the input behavior of course as little as possible. Since transition systems consist of states, events and edges, these components appear as a natural choice for modifications. In this paper we show that the task of converting an unimplementable transition system into an implementable one by removing as few states or events or edges as possible is NP complete regardless of what type of implementation we are aiming for we also show that the corresponding parameterized problems are W 2 hard, where the number of removed components is considered as the parameter finally, we show there is no c approximation algorithm (with a polynomial running time) for neither of these problems, for every constant c geq 1 .


A random supply Mean Field Game price model. We consider a market where a finite number of players trade an asset whose supply is a stochastic process. The price formation problem consists of finding a price process that ensures that when agents act optimally to minimize their trading costs, the market clears, and supply meets demand. This problem arises in market economies, including electricity generation from renewable sources in smart grids. Our model includes noise in the supply side, which is counterbalanced in the consumption side by storing energy or reducing the demand according to a dynamic price process. By solving a constrained minimization problem, we prove that the Lagrange multiplier corresponding to the market clearing condition defines the solution of the price formation problem. For the linear quadratic structure, we characterize the price process using optimal control techniques, and we include two numerical approaches for the price computation.


Formalized Haar Measure. We describe the formalization of the existence and uniqueness of Haar measure in the Lean theorem prover. The Haar measure is an invariant regular measure on locally compact groups, and it has not been formalized in a proof assistant before. We will also discuss the measure theory library in Lean's mathematical library textsf mathlib , and discuss the construction of product measures and the proof of Fubini's theorem for the Bochner integral.


Effect of Word Embedding Variable Parameters on Arabic Sentiment Analysis Performance. Social media such as Twitter, Facebook, etc. has led to a generated growing number of comments that contains users opinions. Sentiment analysis research deals with these comments to extract opinions which are positive or negative. Arabic language is a rich morphological language thus, classical techniques of English sentiment analysis cannot be used for Arabic. Word embedding technique can be considered as one of successful methods to gaping the morphological problem of Arabic. Many works have been done for Arabic sentiment analysis based on word embedding, but there is no study focused on variable parameters. This study will discuss three parameters (Window size, Dimension of vector and Negative Sample) for Arabic sentiment analysis using DBOW and DMPV architectures. A large corpus of previous works generated to learn word representations and extract features. Four binary classifiers (Logistic Regression, Decision Tree, Support Vector Machine and Naive Bayes) are used to detect sentiment. The performance of classifiers evaluated based on Precision, Recall and F1 score.


Singularly Near Optimal Leader Election in Asynchronous Networks. This paper concerns designing distributed algorithms that are em singularly optimal , i.e., algorithms that are em simultaneously time and message em optimal , for the fundamental leader election problem in em asynchronous networks. Kutten et al. (JACM 2015) presented a singularly near optimal randomized leader election algorithm for general em synchronous networks that ran in O(D) time and used O(m log n) messages (where D , m , and n are the network's diameter, number of edges and number of nodes, respectively) with high probability. footnote Throughout, "with high probability" means "with probability at least 1 1 n c , for constant c ." Both bounds are near optimal (up to a logarithmic factor), since Omega(D) and Omega(m) are the respective lower bounds for time and messages for leader election even for synchronous networks and even for (Monte Carlo) randomized algorithms. On the other hand, for general asynchronous networks, leader election algorithms are only known that are either time or message optimal, but not both. Kutten et al. (DISC 2020) presented a randomized asynchronous leader election algorithm that is singularly near optimal for emph complete networks , but left open the problem for general networks. This paper shows that singularly near optimal (up to polylogarithmic factors) bounds can be achieved for general em asynchronous networks. We present a randomized singularly near optimal leader election algorithm that runs in O(D log 2n) time and O(m log 2 n) messages with high probability. Our result is the first known distributed leader election algorithm for asynchronous networks that is near optimal with respect to both time and message complexity and improves over a long line of results including the classical results of Gallager et al. (ACM TOPLAS, 1983), Peleg (JPDC, 1989), and Awerbuch (STOC 89).


Beyond the Sottile Sturmfels degeneration of a semi infinite Grassmannian. We study toric degenerations of semi infinite Grassmannians (a.k.a. quantum Grassmannians). While the toric degenerations of the classical Grassmannians are well studied, the only known example in the semi infinite case is due to Sottile Sturmfels. We start by providing a new interpretation of the Sottile Sturmfels construction by finding a poset such that their degeneration is the toric variety of the order polytope of the poset. We then use our poset to construct and study a new toric degeneration in the semi infinite case. Our construction is based on the notion of poset polytopes introduced by Fang Fourier Litza Pegel. As an application we introduce semi infinite PBW semistandard tableaux, giving a basis in the homogeneous coordinate ring of a semi infinite Grassmannian.


Independence Complex of the Lexicographic Product of a Forest. We study the independence complex of the lexicographic product G H of a forest G and a graph H . We prove that for a forest G which is not dominated by a single vertex, if the independence complex of H is homotopy equivalent to a wedge sum of spheres, then so is the independence complex of G H . We offer two examples of explicit calculations. As the first example, we determine the homotopy type of the independence complex of L m H , where L m is the tree on m vertices with no branches, for any positive integer m when the independence complex of H is homotopy equivalent to a wedge sum of n copies of d dimensional sphere. As the second one, for a forest G and a complete graph K , we describe the homological connectivity of the independence complex of G K by the independent domination number of G .


TAR on Social Media A Framework for Online Content Moderation. Content moderation (removing or limiting the distribution of posts based on their contents) is one tool social networks use to fight problems such as harassment and disinformation. Manually screening all content is usually impractical given the scale of social media data, and the need for nuanced human interpretations makes fully automated approaches infeasible. We consider content moderation from the perspective of technology assisted review (TAR) a human in the loop active learning approach developed for high recall retrieval problems in civil litigation and other fields. We show how TAR workflows, and a TAR cost model, can be adapted to the content moderation problem. We then demonstrate on two publicly available content moderation data sets that a TAR workflow can reduce moderation costs by 20 to 55 across a variety of conditions.


PM 2.5 as a major predictor of COVID 19 basic reproduction number in the USA. Many studies have proposed a relationship between COVID 19 transmissibility and ambient pollution levels. However, a major limitation in establishing such associations is to adequately account for complex disease dynamics, influenced by e.g. significant differences in control measures and testing policies. Another difficulty is appropriately controlling the effects of other potentially important factors, due to both their mutual correlations and a limited dataset. To overcome these difficulties, we will here use the basic reproduction number ( R 0 ) that we estimate for USA states using non linear dynamics methods. To account for a large number of predictors (many of which are mutually strongly correlated), combined with a limited dataset, we employ machine learning methods. Specifically, to reduce dimensionality without complicating the variable interpretation, we employ Principal Component Analysis on subsets of mutually related (and correlated) predictors. Methods that allow feature (predictor) selection, and ranking their importance, are then used, including both linear regressions with regularization and feature selection (Lasso and Elastic Net) and non parametric methods based on ensembles of weak learners (Random Forest and Gradient Boost). Through these substantially different approaches, we robustly obtain that PM 2.5 is a major predictor of R 0 in USA states, with corrections from factors such as other pollutants, prosperity measures, population density, chronic disease levels, and possibly racial composition. As a rough magnitude estimate, we obtain that a relative change in R 0 , with variations in pollution levels observed in the USA, is typically 30 , which further underscores the importance of pollution in COVID 19 transmissibility.


Rectifying the Shortcut Learning of Background for Few Shot Learning. The category gap between training and evaluation has been characterised as one of the main obstacles to the success of Few Shot Learning (FSL). In this paper, we for the first time empirically identify image background, common in realistic images, as a shortcut knowledge helpful for in class classification but ungeneralizable beyond training categories in FSL. A novel framework, COSOC, is designed to tackle this problem by extracting foreground objects in images at both training and evaluation without any extra supervision. Extensive experiments carried on inductive FSL tasks demonstrate the effectiveness of our approaches.


SA Det3D Self Attention Based Context Aware 3D Object Detection. Existing point cloud based 3D object detectors use convolution like operators to process information in a local neighbourhood with fixed weight kernels and aggregate global context hierarchically. However, non local neural networks and self attention for 2D vision have shown that explicitly modeling long range interactions can lead to more robust and competitive models. In this paper, we propose two variants of self attention for contextual modeling in 3D object detection by augmenting convolutional features with self attention features. We first incorporate the pairwise self attention mechanism into the current state of the art BEV, voxel and point based detectors and show consistent improvement over strong baseline models of up to 1.5 3D AP while simultaneously reducing their parameter footprint and computational cost by 15 80 and 30 50 , respectively, on the KITTI validation set. We next propose a self attention variant that samples a subset of the most representative features by learning deformations over randomly sampled locations. This not only allows us to scale explicit global contextual modeling to larger point clouds, but also leads to more discriminative and informative feature descriptors. Our method can be flexibly applied to most state of the art detectors with increased accuracy and parameter and compute efficiency. We show our proposed method improves 3D object detection performance on KITTI, nuScenes and Waymo Open datasets. Code is available at https github.com AutoVision cloud SA Det3D.


Black Box Test Time Shape REFINEment for Single View 3D Reconstruction. Much recent progress has been made in reconstructing the 3D shape of an object from an image of it, i.e. single view 3D reconstruction. However, it has been suggested that current methods simply adopt a "nearest neighbor" strategy, instead of genuinely understanding the shape behind the input image. In this paper, we rigorously show that for many state of the art methods, this issue manifests as (1) inconsistencies between coarse reconstructions and input images, and (2) inability to generalize across domains. We thus propose REFINE, a postprocessing mesh refinement step that can be easily integrated into the pipeline of any black box method in the literature. At test time, REFINE optimizes a network per mesh instance, to encourage consistency between the mesh and the given object view. This, along with a novel combination of regularizing losses, reduces the domain gap and achieves state of the art performance. We believe that this novel paradigm is an important step towards robust, accurate reconstructions, remaining relevant as new reconstruction networks are introduced.


An Elementary System of Axioms for Euclidean Geometry based on Symmetry Principles. In this article, I develop an elementary system of axioms for Euclidean geometry. On one hand, the system is based on the symmetry principles which express our a priori ignorant approach to space all places are the same to us (the homogeneity of space), all directions are the same to us (the isotropy of space) and all units of length we use to create geometric figures are the same to us (the scale invariance of space). On the other hand, through the process of algebraic simplification, this system of axioms directly provides Weyl's system of axioms for Euclidean geometry. The system of axioms, together with its a priori interpretation, offers new views to philosophy and pedagogy of mathematics (i) it supports the thesis that Euclidean geometry is a priori, (ii) it supports the thesis that in modern mathematics the Weyl's system of axioms is dominant to Euclid's system because it reflects the a priori underlying symmetries, (iii) it gives a new and promising approach to learn geometry which, through the Weyl's system of axioms, leads from the essential geometric symmetry principles of the mathematical nature directly to modern mathematics.


From sum of two squares to arithmetic Siegel Weil formulas. The main goal of this expository article is to survey recent progress on the arithmetic Siegel Weil formula and its applications. We begin with the classical sum of two squares problem and put it in the context of the Siegel Weil formula. We then motivate the geometric and arithmetic Siegel Weil formula using the classical example of the product of modular curves. After explaining the recent result on the arithmetic Siegel Weil formula for Shimura varieties of arbitrary dimension, we discuss some aspects of the proof and its application to the arithmetic inner product formula and the Beilinson Bloch conjecture. Rather than intended to be a complete survey of this vast field, this article focuses more on examples and background to provide easier access to the recent works LZ,LZ21, LL, LL21 .


Semi supervised Cell Detection in Time lapse Images Using Temporal Consistency. Cell detection is the task of detecting the approximate positions of cell centroids from microscopy images. Recently, convolutional neural network based approaches have achieved promising performance. However, these methods require a certain amount of annotation for each imaging condition. This annotation is a time consuming and labor intensive task. To overcome this problem, we propose a semi supervised cell detection method that effectively uses a time lapse sequence with one labeled image and the other images unlabeled. First, we train a cell detection network with a one labeled image and estimate the unlabeled images with the trained network. We then select high confidence positions from the estimations by tracking the detected cells from the labeled frame to those far from it. Next, we generate pseudo labels from the tracking results and train the network by using pseudo labels. We evaluated our method for seven conditions of public datasets, and we achieved the best results relative to other semi supervised methods. Our code is available at https github.com naivete5656 SCDTC


An effective coaxiality measurement for twist drill based on line structured light sensor. Aiming at the accurate and effective coaxiality measurement for twist drill with irregular surface, an optical measurement mechanism is proposed in this paper. First, A high precision rotation instrument based on four core units is designed, which can obtain the 3 D point cloud data of full angle for the twist drill. Second, in the data processing stage, an improved robust Gaussian mixture model is established for accurate and rapid blade back segmentation. To improve measurement efficiency, a rapid reconstruction method of the twist drill axis based on orthogonal synthesis is provided to locate the axial position of the maximum deviation from the benchmark by utilizing the extracted blade back data. Finally, by calculating the maximum radial Euclidean distance from the benchmark, the coaxiality error of the twist drill is obtained. Comparing with other measurement methods, experimental results show that our proposed method is effective with high precision of 3 um and high efficiency of less than 3 s pc. The result demonstrate that the proposed method is effective, robust and automatic, it can be applied in many actual industrial scene.


Toward a flow structure based wall modeled large eddy simulation paradigm. A promising and cost effective method for numerical simulation of high Re wall bounded flows is wall modeled large eddy simulation. Most wall models are formulated from the Reynolds averaged Navier Stokes equations (RANS). These RANS based wall models are calibrated using mean turbulence data and make no use of the current vast knowledge on turbulent flow structure. Moreover, RANS based models are limited to predicting the mean velocity profile, and the mean wall shear stress. Using the knowledge of the wall normal self similarity of high Re tau wall bounded turbulent flows, we present a coupling between a near wall patch of DNS resolution fixed in inner units and an outer LES flow field. The near wall patch captures the near wall self sustaining cycle as well as the lower portion of the self similar hierarchy of eddies. Given that both the near wall patch and the LES capture separate portions of the self similar hierarchy of eddies an instantaneous top boundary condition for the patch is formulated. The near wall model is capable of predicting subgrid scale quantities such as the wall stress, velocity fluctuations, kinetic energy spectra, and flow structure across the entire near wall layer.


SelfCF A Simple Framework for Self supervised Collaborative Filtering. Collaborative filtering (CF) is widely used to learn an informative latent representation of a user or item from observed interactions. Existing CF based methods commonly adopt negative sampling to discriminate different items. That is, observed user item pairs are treated as positive instances unobserved pairs are considered as negative instances and are sampled under a defined distribution for training. Training with negative sampling on large datasets is computationally expensive. Further, negative items should be carefully sampled under the defined distribution, in order to avoid selecting an observed positive item in the training dataset. Unavoidably, some negative items sampled from the training dataset could be positive in the test set. Recently, self supervised learning (SSL) has emerged as a powerful tool to learn a model without negative samples. In this paper, we propose a self supervised collaborative filtering framework (SelfCF), that is specially designed for recommender scenario with implicit feedback. The main idea of SelfCF is to augment the output embeddings generated by backbone networks, because it is infeasible to augment raw input of user item ids. We propose and study three output perturbation techniques that can be applied to different types of backbone networks including both traditional CF models and graph based models. By encapsulating two popular recommendation models into the framework, our experiments on three datasets show that the best performance of our framework is comparable or better than the supervised counterpart. We also show that SelfCF can boost up the performance by up to 8.93 on average, compared with another self supervised framework as the baseline. Source codes are available at https github.com enoche SelfCF.


The Bloch Okounkov theorem for congruence subgroups and Taylor coefficients of quasi Jacobi forms. There are many families of functions on partitions, such as the shifted symmetric functions, for which the corresponding q brackets are quasimodular forms. We extend these families so that the corresponding q brackets are quasimodular for a congruence subgroup. Moreover, we find subspaces of these families for which the q bracket is a modular form. These results follow from the properties of Taylor coefficients of strictly meromorphic quasi Jacobi forms around rational lattice points.


A concise and universal method for deriving arbitrary paraxial and non paraxial cylindrical Gaussian type light modes. A concise method of deriving expressions for Gaussian like solutions of the paraxial and d'Alembert equations is presented. This method is based on the Hankel transform. Choosing some Gaussian base functions with slight modifications of the prefactor all basic beams of cylindrical character can be easily obtained. This refers to Gaussian, Bessel Gaussian, modified Bessel Gaussian, Laguerre Gaussian and Kummer Gaussian (i.e., Hypergeometric Gaussian) beams although potentially other beams can come into play as well. For instance a new type of a beam that can be derived in this way is described through the incomplete gamma function so it may be called a gamma beam.


Interpretable Mammographic Image Classification using Case Based Reasoning and Deep Learning. When we deploy machine learning models in high stakes medical settings, we must ensure these models make accurate predictions that are consistent with known medical science. Inherently interpretable networks address this need by explaining the rationale behind each decision while maintaining equal or higher accuracy compared to black box models. In this work, we present a novel interpretable neural network algorithm that uses case based reasoning for mammography. Designed to aid a radiologist in their decisions, our network presents both a prediction of malignancy and an explanation of that prediction using known medical features. In order to yield helpful explanations, the network is designed to mimic the reasoning processes of a radiologist our network first detects the clinically relevant semantic features of each image by comparing each new image with a learned set of prototypical image parts from the training images, then uses those clinical features to predict malignancy. Compared to other methods, our model detects clinical features (mass margins) with equal or higher accuracy, provides a more detailed explanation of its prediction, and is better able to differentiate the classification relevant parts of the image.


On L 2 extension from singular hypersurfaces. In L 2 extension theorems from a singular hypersurface in a complex manifold, some important roles are played by certain measures such as the Ohsawa measure which determine when a given function can be extended. In this paper, we show that the singularity of the Ohsawa measure can be identified in terms of algebraic geometry. Using this, we give an analytic proof of the inversion of adjunction in this setting. Then these considerations enable us to compare various positive and negative results on L 2 extension from singular hypersurfaces. In particular, we generalize a recent negative result of Guan and Li which places limitations on strengthening such L 2 extension by employing a less singular measure in the place of the Ohsawa measure.


Analysis of Super resolution Single Molecule Localization Microscopy Data a tutorial. The diffraction of light imposes a fundamental limit on the resolution of light microscopes. This limit can be circumvented by creating and exploiting independent behaviors of the sample at length scales below the diffraction limit. In super resolution single molecule localization microscopy (SMLM), the independence arises from individual fluorescent labels stochastically switching between dark and fluorescent states, which in turn allows the pinpointing of fluorophores post experimentally using a sequence of acquired sparse image frames. Finally, the resulting list of fluorophore coordinates is utilized to produce high resolution images or to gain quantitative insight into the underlying biological structures. Therefore, image processing and post processing are essential stages of SMLM. Here, we review the latest progress on SMLM data processing and post processing.


Trivalent vertex transitive graphs with infinite vertex stabilizers. We study groups acting vertex transitively on connected, trivalent graphs such that stabilizers of vertices are infinite. If the action is edge transitive, we prove that the graph has to be a tree. We analyze the case where the action is not edge transitive and fully classify the possible 2 ended graphs. We draw connections to Willis' scale function and re prove a result by Trofimov.


Discourse level Relation Extraction via Graph Pooling. The ability to capture complex linguistic structures and long term dependencies among words in the passage is essential for discourse level relation extraction (DRE) tasks. Graph neural networks (GNNs), one of the methods to encode dependency graphs, have been shown effective in prior works for DRE. However, relatively little attention has been paid to receptive fields of GNNs, which can be crucial for cases with extremely long text that requires discourse understanding. In this work, we leverage the idea of graph pooling and propose to use pooling unpooling framework on DRE tasks. The pooling branch reduces the graph size and enables the GNNs to obtain larger receptive fields within fewer layers the unpooling branch restores the pooled graph to its original resolution so that representations for entity mention can be extracted. We propose Clause Matching (CM), a novel linguistically inspired graph pooling method for NLP tasks. Experiments on two DRE datasets demonstrate that our models significantly improve over baselines when modeling long term dependencies is required, which shows the effectiveness of the pooling unpooling framework and our CM pooling method.


An algorithm for Egyptian fraction representations with restricted denominators. A unit fraction representation of a rational number r is a finite sum of reciprocals of positive integers that equals r . Of particular interest is the case when all denominators in the representation are distinct, resulting in an Egyptian fraction representation of r . Common algorithms for computing Egyptian fraction representations of a given rational number tend to result in extremely large denominators and cannot be adapted to restrictions on the allowed denominators. We describe an algorithm for finding all unit fraction representations of a given rational number using denominators from a given finite multiset of positive integers. The freely available algorithm, implemented in Scheme, is particularly well suited to computing dense Egyptian fraction representations, where the allowed denominators have a prescribed maximum.


Releasing Locks As Early As You Can Reducing Contention of Hotspots by Violating Two Phase Locking (Extended Version). Hotspots, a small set of tuples frequently read written by a large number of transactions, cause contention in a concurrency control protocol. While a hotspot may comprise only a small fraction of a transaction's execution time, conventional strict two phase locking allows a transaction to release lock only after the transaction completes, which leaves significant parallelism unexploited. Ideally, a concurrency control protocol serializes transactions only for the duration of the hotspots, rather than the duration of transactions. We observe that exploiting such parallelism requires violating two phase locking. In this paper, we propose Bamboo, a new concurrency control protocol that can enable such parallelism by modifying the conventional two phase locking, while maintaining the same guarantees in correctness. We thoroughly analyzed the effect of cascading aborts involved in reading uncommitted data and discussed optimizations that can be applied to further improve the performance. Our evaluation on TPC C shows a performance improvement up to 4x compared to the best of pessimistic and optimistic baseline protocols. On synthetic workloads that contain a single hotspot, Bamboo achieves a speedup up to 19x over baselines.


Linear port Hamiltonian systems are generically controllable. The new concept of relative generic subsets is introduced. It is shown that the set of controllable linear finite dimensional port Hamiltonian systems is a relative generic subset of the set of all linear finite dimensional port Hamiltonian systems. This implies that a random, continuously distributed port Hamiltonian system is almost surely controllable.


Modelling and simulation of electrical propagation in transmural slabs of scarred left ventricle tissue. We report three dimensional and time dependent numerical simulations of the propagation of electrical action potentials in a model of rabbit ventricular tissue. The simulations are performed using a finite element method for the solution of the monodomain equations of cardiac electrical excitation. The parameters of a detailed ionic ventricular cell model are re fitted to available experimental data and the model is then used for the description of the transmembrane current and calcium dynamics. A region with reduced conductivity is introduced to model a myocardial infarction scar. Electrical activation times and density maps of the transmembrane voltage are computed and compared with experimental measurements in rabbit preparations with myocardial infarction obtained by a panoramic optical mapping method.


Equiseparability on Terminal Wiener Index and Distances. Teminal Wiener index is one of the commonly used topological index in mathematical chemistry. If two or more chemical compounds have the same terminal Wiener index then they will have similar physico chemical properties. In this work we propose a new method for constructing equiseparable trees w.r.t terminal Wiener index. The existing method is based on the number of pendent vertices but the proposed method is based on distance parameters.


On the Importance of Effectively Adapting Pretrained Language Models for Active Learning. Recent Active Learning (AL) approaches in Natural Language Processing (NLP) proposed using off the shelf pretrained language models (LMs). In this paper, we argue that these LMs are not adapted effectively to the downstream task during AL and we explore ways to address this issue. We suggest to first adapt the pretrained LM to the target task by continuing training with all the available unlabeled data and then use it for AL. We also propose a simple yet effective fine tuning method to ensure that the adapted LM is properly trained in both low and high resource scenarios during AL. Our experiments demonstrate that our approach provides substantial data efficiency improvements compared to the standard fine tuning approach, suggesting that a poor training strategy can be catastrophic for AL.


Robust and stochastic compliance based topology optimization with finitely many loading scenarios. In this paper, the problem of load uncertainty in compliance problems is addressed where the uncertainty is described in the form of a set of finitely many loading scenarios. Computationally more efficient methods are proposed to exactly evaluate and differentiate 1) the mean compliance, or 2) any scalar valued function of the individual load compliances such as the weighted sum of the mean and standard deviation. The computational time complexities of all the proposed algorithms are analyzed, compared with the naive approaches and then experimentally verified. Finally, a mean compliance minimization problem, a risk averse compliance minimization problem and a maximum compliance constrained problem are solved to showcase the efficacy of the proposed algorithms. The maximum compliance constrained problem is solved using the augmented Lagrangian method and the method proposed for handling scalar valued functions of the load compliances, where the scalar valued function is the augmented Lagrangian function.


Near optimal Representation Learning for Linear Bandits and Linear RL. This paper studies representation learning for multi task linear bandits and multi task episodic RL with linear value function approximation. We first consider the setting where we play M linear bandits with dimension d concurrently, and these bandits share a common k dimensional linear representation so that k ll d and k ll M . We propose a sample efficient algorithm, MTLR OFUL, which leverages the shared representation to achieve tilde O (M sqrt dkT d sqrt kMT ) regret, with T being the number of total steps. Our regret significantly improves upon the baseline tilde O (Md sqrt T ) achieved by solving each task independently. We further develop a lower bound that shows our regret is near optimal when d M . Furthermore, we extend the algorithm and analysis to multi task episodic RL with linear value function approximation under low inherent Bellman error citep zanette2020learning . To the best of our knowledge, this is the first theoretical result that characterizes the benefits of multi task representation learning for exploration in RL with function approximation.


Interpretable fields in real closed valued fields and some expansions. Let mathcal M langle K O rangle be a real closed valued field and let k be its residue field. We prove that every interpretable field in mathcal M is definably isomorphic to either K , K( sqrt 1 ) , k , or k( sqrt 1 ) . The same result holds when K is a model of T , for T an o minimal power bounded expansion of a real closed field, and O is a T convex subring. The proof is direct and does not make use of known results about elimination of imaginaries in valued fields.


Cohen Lenstra Partitions and Mutually Annihilating Matrices over a Finite Field. Motivated by questions in algebraic geometry, Yifeng Huang recently derived generating functions for counting mutually annihilating matrices and mutually annihilating nilpotent matrices over a finite field. We give a different derivation of his results using statistical properties of random partitions chosen from the Cohen Lenstra measure.


Generation of Intense Phase Stable Femtosecond Hard X ray Pulse Pairs. Coherent nonlinear spectroscopies and imaging in the X ray domain provide direct insight into the coupled motions of electrons and nuclei with resolution on the electronic length and time scale. The experimental realization of such techniques will strongly benefit from access to intense, coherent pairs of femtosecond X ray pulses. We have observed phase stable X ray pulse pairs containing more thank 3 x 10e7 photons at 5.9 keV (2.1 Angstrom) with about 1 fs duration and 2 5 fs separation. The highly directional pulse pairs are manifested by interference fringes in the superfluorescent and seeded stimulated manganese K alpha emission induced by an X ray free electron laser. The fringes constitute the time frequency X ray analogue of the Young double slit interference allowing for frequency domain X ray measurements with attosecond time resolution.


Uplink Power Control in Massive MIMO with Double Scattering Channels. Massive multiple input multiple output (MIMO) is a key technology for improving the spectral and energy efficiency in 5G and beyond wireless networks. For a tractable analysis, most of the previous works on Massive MIMO have been focused on the system performance with complex Gaussian channel impulse responses under rich scattering environments. In contrast, this paper investigates the uplink ergodic spectral efficiency (SE) of each user under the double scattering channel model. We derive a closed form expression of the uplink ergodic SE by exploiting the maximum ratio (MR) combining technique based on imperfect channel state information. We further study the asymptotic SE behaviors as a function of the number of antennas at each base station (BS) and the number of scatterers available at each radio channel. We then formulate and solve a total energy optimization problem for the uplink data transmission that aims at simultaneously satisfying the required SEs from all the users with limited data power resource. Notably, our proposed algorithms can cope with the congestion issue appearing when at least one user is served by lower SE than requested. Numerical results illustrate the effectiveness of the closed form ergodic SE over Monte Carlo simulations. Besides, the system can still provide the required SEs to many users even under congestion.


SkyCam A Dataset of Sky Images and their Irradiance values. Recent advances in Computer Vision and Deep Learning have enabled astonishing results in a variety of fields and applications. Motivated by this success, the SkyCam Dataset aims to enable image based Deep Learning solutions for short term, precise prediction of solar radiation on a local level. For the span of a year, three different cameras in three topographically different locations in Switzerland are acquiring images of the sky every 10 seconds. Thirteen high resolution images with different exposure times are captured and used to create an additional HDR image. The images are paired with highly precise irradiance values gathered from a high accuracy pyranometer.


Counting Lines with Vinberg's algorithm. We combine classical Vinberg's algorithms with the lattice theoretic arithmetic approach from arXiv 1706.05734 math.AG to give a method of classifying large line configurations on complex quasi polarized K3 surfaces. We apply our method to classify all complex K3 octic surfaces with at worst Du Val singularities and at least 32 lines. The upper bound on the number of lines is 36, as in the smooth case, with at most 32 lines if the singular locus is non empty.


An Advanced Parallel PageRank Algorithm. Initially used to rank web pages, PageRank has now been applied in many fields. In general case, there are plenty of special vertices such as dangling vertices and unreferenced vertices in the graph. Existing PageRank algorithms usually consider them as bad vertices since they may take troubles. However, in this paper, we propose a parallel PageRank algorithm which can take advantage of these special vertices. For this end, we firstly interpret PageRank from the information transmitting perspective and give a constructive definition of PageRank. Then, based on the information transmitting interpretation, a parallel PageRank algorithm which we call the Information Transmitting Algorithm(ITA) is proposed. We prove that the dangling vertices can increase ITA's convergence rate and the unreferenced vertices and weak unreferenced vertices can decrease ITA's calculations. Compared with the MONTE CARLO method, ITA has lower bandwidth requirement. Compared with the power method, ITA has higher convergence rate and generates less calculations. Finally, experimental results on four data sets demonstrate that ITA is 1.5 4 times faster than the power method and converges more uniformly.


About the enstrophy change of the Reynolds Orr solution in the channel flow. The plane Poiseuille flow is one of the elementary flow configurations. Although its laminar turbulent transition mechanism is investigated intensively in the last century, the significant difference in the critical Reynolds number between the experiments and theory lacks a clear explanation. In this paper, an attempt is made to reduce this gap by analysing the Reynolds Orr equation solution. Recent literature results showed that the usage of enstrophy (the volume integral of the vorticity) instead of the kinetic energy as the norm of perturbations predicts higher Reynolds numbers in the two dimensional case. Its usage in three dimensions is discussed in the paper. In addition, other research showed an improvement of the original Reynolds Orr energy equation using the weighted norm in a tilted coordinate system. Here, these two methods are combined. The zero enstrophy growth constraint is applied to the classical Reynolds Orr equation, and then the solution is further refined in the tilted coordinate system. The results are compared to direct numerical simulations from the literature.


Hyperbolicity of Renormalization for bi cubic circle maps with bounded combinatorics. We construct a hyperbolic attractor of renormalization of bi cubic circle maps with bounded combinatorics, with a codimension two stable foliation.


SVG Net An SVG based Trajectory Prediction Model. Anticipating motions of vehicles in a scene is an essential problem for safe autonomous driving systems. To this end, the comprehension of the scene's infrastructure is often the main clue for predicting future trajectories. Most of the proposed approaches represent the scene with a rasterized format and some of the more recent approaches leverage custom vectorized formats. In contrast, we propose representing the scene's information by employing Scalable Vector Graphics (SVG). SVG is a well established format that matches the problem of trajectory prediction better than rasterized formats while being more general than arbitrary vectorized formats. SVG has the potential to provide the convenience and generality of raster based solutions if coupled with a powerful tool such as CNNs, for which we introduce SVG Net. SVG Net is a Transformer based Neural Network that can effectively capture the scene's information from SVG inputs. Thanks to the self attention mechanism in its Transformers, SVG Net can also adequately apprehend relations amongst the scene and the agents. We demonstrate SVG Net's effectiveness by evaluating its performance on the publicly available Argoverse forecasting dataset. Finally, we illustrate how, by using SVG, one can benefit from datasets and advancements in other research fronts that also utilize the same input format. Our code is available at https vita epfl.github.io SVGNet .


Modulation of Cathodoluminescence Emission by Interference with External Light. Spontaneous processes triggered in a sample by free electrons are commonly regarded as incoherent, and therefore unable to interfere with external light sources. Here, we challenge this concept by showing through first principles theory that light and free electron pulses can interfere when interacting with a nanostructure, giving rise to a modulation in the spectral distribution of the cathodoluminescence light emission that is strongly dependent on the electron wave function. Specifically, for a temporally focused electron, cathodoluminescence can be cancelled upon illumination with a spectrally modulated dimmed laser that is phase locked relative to the electron density profile. We illustrate this idea with realistic simulations under attainable conditions in currently available ultrafast electron microscopes. We further argue that the interference between excitations produced by light and free electrons opens a new window to manipulate the ultrafast materials response by combining the spectral and temporal selectivity of the light with the atomic resolution of electron beams.


FedSup A Communication Efficient Federated Learning Fatigue Driving Behaviors Supervision Framework. With the proliferation of edge smart devices and the Internet of Vehicles (IoV) technologies, intelligent fatigue detection has become one of the most used methods in our daily driving. To improve the performance of the detection model, a series of techniques have been developed. However, existing work still leaves much to be desired, such as privacy disclosure and communication cost. To address these issues, we propose FedSup, a client edge cloud framework for privacy and efficient fatigue detection. Inspired by the federated learning technique, FedSup intelligently utilizes the collaboration between client, edge, and cloud server to realizing dynamic model optimization while protecting edge data privacy. Moreover, to reduce the unnecessary system communication overhead, we further propose a Bayesian convolutional neural network (BCNN) approximation strategy on the clients and an uncertainty weighted aggregation algorithm on the cloud to enhance the central model training efficiency. Extensive experiments demonstrate that the FedSup framework is suitable for IoV scenarios and outperforms other mainstream methods.


An Investigative Model of Adult Cyberbullying A Court Case Analysis. Cyberbullying is a major social issue that is on the rise with a substantial potential to impact a large number of Internet users globally. The growth and rapid proliferation of the Internet and other ubiquitous technologies like social media and smart mobile devices have increased the propensity of cyberbullying, providing it with a wider audience and rapid access. This research developed an investigative model for cyberbullying, specifically developed for adults. Therein, the model considers the cyberbullying journey from conception of the bullying idea, identification of the target to the bullying as an action. The a priori model is motivated by the General Theory of Crime and the Routine Activity Theory. The a priori model is then validated using 20 cyberbullying court cases from Australia, Canada, the United States and Scotland.


Software Variants for Hardware Trojan Detection and Resilience in COTS Processors. The commercial off the shelf (COTS) component based ecosystem provides an attractive system design paradigm due to the drastic reduction in development time and cost compared to custom solutions. However, it brings in a growing concern of trustworthiness arising from the possibility of embedded malicious logic, or hardware Trojans in COTS components. Existing trust verification approaches are typically not applicable to COTS hardware due to the absence of golden models and the lack of observability of internal signals. In this work, we propose a novel approach for runtime Trojan detection and resilience in untrusted COTS processors through judicious modifications in software. The proposed approach does not rely on any hardware redundancy or architectural modification and hence seamlessly integrates with the COTS based system design process. Trojan resilience is achieved through the execution of multiple functionally equivalent software variants. We have developed and implemented a solution for compiler based automatic generation of program variants, metric guided selection of variants, and their integration in a single executable. To evaluate the proposed approach, we first analyzed the effectiveness of program variants in avoiding the activation of a random pool of Trojans. By implementing several Trojans in an OpenRISC 1000 processor, we analyzed the detectability and resilience during Trojan activation in both single and multiple variants. We also present delay and code size overhead for the automatically generated variants for several programs and discuss future research directions to reduce the overhead.


In Situ Photothermal Response of Single Gold Nanoparticles Through Hyperspectral Imaging AntiStokes Thermometry. Several fields of applications require a reliable characterization of the photothermal response and heat dissipation of nanoscopic systems, which remains a challenging task both for modeling and experimental measurements. Here, we present a new implementation of anti Stokes thermometry that enables the in situ photothermal characterization of individual nanoparticles (NPs) from a single hyperspectral photoluminescence confocal image. The method is label free, applicable to any NP with detectable anti Stokes emission, and does not require any prior information about the NP itself or the surrounding media. With it, we first studied the photothermal response of spherical gold NPs of different sizes on glass substrates, immersed in water, and found that heat dissipation is mainly dominated by the water for NPs larger than 50 nm. Then, the role of the substrate was studied by comparing the photothermal response of 80 nm gold NPs on glass with sapphire and graphene, two materials with high thermal conductivity. For a given irradiance level, the NPs reach temperatures 18 lower on sapphire and 24 higher on graphene than on bare glass. The fact that the presence of a highly conductive material such as graphene leads to a poorer thermal dissipation demonstrates that interfacial thermal resistances play a very significant role in nanoscopic systems, and emphasize the need for in situ experimental thermometry techniques. The developed method will allow addressing several open questions about the role of temperature in plasmon assisted applications, especially ones where NPs of arbitrary shapes are present in complex matrixes and environments.


Dual microcomb generation in a synchronously driven waveguide ring resonator. Microcombs optical frequency combs generated in coherently driven nonlinear microresonators have attracted significant attention over the last decade. The ability to generate two such combs in a single resonator device has in particular enabled a host of applications from spectroscopy to imaging. Concurrently, novel comb generation techniques such as synchronous pulsed driving have been developed to enhance the efficiency and flexibility of microcomb generation. Here we report on the first experimental demonstration of dual microcomb generation via synchronous pulsed pumping of a single microresonator. Specifically, we use two electro optically generated pulse trains derived from a common continuous wave laser to simultaneously drive two orthogonal polarization modes of an integrated silica ring resonator, observing the generation of coherent dissipative Kerr cavity soliton combs on both polarization axes. Thanks to the resonator birefringence, the two soliton combs are associated with different repetition rates, thus realizing a dual microcomb source. To illustrate the source's application potential, we demonstrate proof of concept spectroscopic measurements.


Using GPT 2 to Create Synthetic Data to Improve the Prediction Performance of NLP Machine Learning Classification Models. Classification Models use input data to predict the likelihood that the subsequent input data will fall into predetermined categories. To perform effective classifications, these models require large datasets for training. It is becoming common practice to utilize synthetic data to boost the performance of Machine Learning Models. It is reported that Shell is using synthetic data to build models to detect problems that rarely occur for example Shell created synthetic data to help models to identify deteriorating oil lines. It is common practice for Machine Learning Practitioners to generate synthetic data by rotating, flipping, and cropping images to increase the volume of image data to train Convolutional Neural Networks. The purpose of this paper is to explore creating and utilizing synthetic NLP data to improve the performance of Natural Language Processing Machine Learning Classification Models. In this paper I used a Yelp pizza restaurant reviews dataset and transfer learning to fine tune a pre trained GPT 2 Transformer Model to generate synthetic pizza reviews data. I then combined this synthetic data with the original genuine data to create a new joint dataset. The new combined model significantly outperformed the original model in accuracy and precision.


Exploration in Deep Reinforcement Learning A Comprehensive Survey. Deep Reinforcement Learning (DRL) and Deep Multi agent Reinforcement Learning (MARL) have achieved significant success across a wide range of domains, such as game AI, autonomous vehicles, robotics and finance. However, DRL and deep MARL agents are widely known to be sample inefficient and millions of interactions are usually needed even for relatively simple game settings, thus preventing the wide application in real industry scenarios. One bottleneck challenge behind is the well known exploration problem, i.e., how to efficiently explore the unknown environments and collect informative experiences that could benefit the policy learning most. In this paper, we conduct a comprehensive survey on existing exploration methods in DRL and deep MARL for the purpose of providing understandings and insights on the critical problems and solutions. We first identify several key challenges to achieve efficient exploration, which most of the exploration methods aim at addressing. Then we provide a systematic survey of existing approaches by classifying them into two major categories uncertainty oriented exploration and intrinsic motivation oriented exploration. The essence of uncertainty oriented exploration is to leverage the quantification of the epistemic and aleatoric uncertainty to derive efficient exploration. By contrast, intrinsic motivation oriented exploration methods usually incorporate different reward agnostic information for intrinsic exploration guidance. Beyond the above two main branches, we also conclude other exploration methods which adopt sophisticated techniques but are difficult to be classified into the above two categories. In addition, we provide a comprehensive empirical comparison of exploration methods for DRL on a set of commonly used benchmarks. Finally, we summarize the open problems of exploration in DRL and deep MARL and point out a few future directions.


CogView Mastering Text to Image Generation via Transformers. Text to Image generation in the general domain has long been an open problem, which requires both a powerful generative model and cross modal understanding. We propose CogView, a 4 billion parameter Transformer with VQ VAE tokenizer to advance this problem. We also demonstrate the finetuning strategies for various downstream tasks, e.g. style learning, super resolution, text image ranking and fashion design, and methods to stabilize pretraining, e.g. eliminating NaN losses. CogView achieves the state of the art FID on the blurred MS COCO dataset, outperforming previous GAN based models and a recent similar work DALL E.


Minimum Jerk Trajectory Generation for Straight and Curved Movements Mathematical Analysis. In this chapter, the mathematical analysis of the minimum jerk trajectory (MJT) generation is performed. In this study, the position and the velocity of the minimum jerk trajectory as a function of time is presented in two cases the first one is the unconstrained point to point movements of the human hand, whereas the second case is the curved point to point movements of the human hand. Simulation study is carried out with some examples and MATLAB is used for this simulation. The results prove that the minimum jerk trajectory is the smoothest possible movement of the human hand.


Blow up phenomena and asymptotic profiles passing from H 1 critical to super critical quasilinear Schr " o dinger equations. We study the asymptotic profile, as hbar rightarrow 0 , of positive solutions to hbar 2 Delta u V(x)u hbar 2 gamma u Delta u 2 K(x) u p 2 u, x in mathbb R N where gamma geq 0 is a parameter with relevant physical interpretations, V and K are given potentials and N geq 5 . We investigate the concentrating behavior of solutions when gamma 0 and, differently form the case gamma 0 where the leading potential is V , the concentration is here localized by the source potential K . Moreover, surprisingly for gamma 0 we find a different concentration behavior of solutions in the case p frac 2N N 2 and when frac 2N N 2 p frac 4N N 2 . This phenomenon does not occur when gamma 0 .


spatialSim multi species spatiotemporal size structured operating model for management strategy evaluation. Spatiotemporal processes have the potential to be one of the most influential factors governing how fisheries targeting sedentary species respond to harvesting. Despite this, management strategy evaluation often fails to account for space or does so at low resolutions due to compute constraints. In this paper, a multi species spatiotemporal size structured operating model for sedentary species is presented. The model combines a spatially continuous Gaussian Markov Random Field model of the population dynamics with an areal harvesting model that supports preferential targeting and site selection constraints (e.g., economic constraints). This approach is very compute efficient, which makes it feasible to simulate realistic fisher dynamics and catch data at true spatial scale (e.g., the swept area of a dredge). The New Zealand surfclam fishery was used as a case study to demonstrate the versatility of the operating model and to showcase the simulation of localized depletion, which was manifest in the generation of realistic catch per unit effort data that were uncorrelated with the trends in population abundance. The model is available as part of the open source R package spatialSim.


"What makes my queries slow?" Subgroup Discovery for SQL Workload Analysis. Among daily tasks of database administrators (DBAs), the analysis of query workloads to identify schema issues and improving performances is crucial. Although DBAs can easily pinpoint queries repeatedly causing performance issues, it remains challenging to automatically identify subsets of queries that share some properties only (a pattern) and simultaneously foster some target measures, such as execution time. Patterns are defined on combinations of query clauses, environment variables, database alerts and metrics and help answer questions like what makes SQL queries slow? What makes I O communications high? Automatically discovering these patterns in a huge search space and providing them as hypotheses for helping to localize issues and root causes is important in the context of explainable AI. To tackle it, we introduce an original approach rooted on Subgroup Discovery. We show how to instantiate and develop this generic data mining framework to identify potential causes of SQL workloads issues. We believe that such data mining technique is not trivial to apply for DBAs. As such, we also provide a visualization tool for interactive knowledge discovery. We analyse a one week workload from hundreds of databases from our company, make both the dataset and source code available, and experimentally show that insightful hypotheses can be discovered.


Promoting Self Efficacy Through an Effective Human Powered Nonvisual Smartphone Task Assistant. Accessibility assessments typically focus on determining a binary measurement of task performance success failure and often neglect to acknowledge the nuances of those interactions. Although a large population of blind people find smartphone interactions possible, many experiences take a significant toll and can have a lasting negative impact on the individual and their willingness to step out of technological comfort zones. There is a need to assist and support individuals with the adoption and learning process of new tasks to mitigate these negative experiences. We contribute with a human powered nonvisual task assistant for smartphones to provide pervasive assistance. We argue, in addition to success, one must carefully consider promoting and evaluating factors such as self efficacy and the belief in one's own abilities to control and learn to use technology. In this paper, we show effective assistant positively affects self efficacy when performing new tasks with smartphones, affects perceptions of accessibility and enables systemic task based learning.


Parareal Neural Networks Emulating a Parallel in time Algorithm. As deep neural networks (DNNs) become deeper, the training time increases. In this perspective, multi GPU parallel computing has become a key tool in accelerating the training of DNNs. In this paper, we introduce a novel methodology to construct a parallel neural network that can utilize multiple GPUs simultaneously from a given DNN. We observe that layers of DNN can be interpreted as the time step of a time dependent problem and can be parallelized by emulating a parallel in time algorithm called parareal. The parareal algorithm consists of fine structures which can be implemented in parallel and a coarse structure which gives suitable approximations to the fine structures. By emulating it, the layers of DNN are torn to form a parallel structure which is connected using a suitable coarse network. We report accelerated and accuracy preserved results of the proposed methodology applied to VGG 16 and ResNet 1001 on several datasets.


Loss Aversively Fair Classification. The use of algorithmic (learning based) decision making in scenarios that affect human lives has motivated a number of recent studies to investigate such decision making systems for potential unfairness, such as discrimination against subjects based on their sensitive features like gender or race. However, when judging the fairness of a newly designed decision making system, these studies have overlooked an important influence on people's perceptions of fairness, which is how the new algorithm changes the status quo, i.e., decisions of the existing decision making system. Motivated by extensive literature in behavioral economics and behavioral psychology (prospect theory), we propose a notion of fair updates that we refer to as loss averse updates. Loss averse updates constrain the updates to yield improved (more beneficial) outcomes to subjects compared to the status quo. We propose tractable proxy measures that would allow this notion to be incorporated in the training of a variety of linear and non linear classifiers. We show how our proxy measures can be combined with existing measures for training nondiscriminatory classifiers. Our evaluation using synthetic and real world datasets demonstrates that the proposed proxy measures are effective for their desired tasks.


A robust collision source method for rank adaptive dynamical low rank approximation in radiation therapy. Deterministic models for radiation transport describe the density of radiation particles moving through a background material. In radiation therapy applications, the phase space of this density is composed of energy, spatial position and direction of flight. The resulting six dimensional phase space prohibits fine numerical discretizations, which are essential for the construction of accurate and reliable treatment plans. In this work, we tackle the high dimensional phase space through a dynamical low rank approximation of the particle density. Dynamical low rank approximation (DLRA) evolves the solution on a low rank manifold in time. Interpreting the energy variable as a pseudo time lets us employ the DLRA framework to represent the solution of the radiation transport equation on a low rank manifold for every energy. Stiff scattering terms are treated through an efficient implicit energy discretization and a rank adaptive integrator is chosen to dynamically adapt the rank in energy. To facilitate the use of boundary conditions and reduce the overall rank, the radiation transport equation is split into collided and uncollided particles through a collision source method. Uncollided particles are described by a directed quadrature set guaranteeing low computational costs, whereas collided particles are represented by a low rank solution. It can be shown that the presented method is L 2 stable under a time step restriction which does not depend on stiff scattering terms. Moreover, the implicit treatment of scattering does not require numerical inversions of matrices. Numerical results for radiation therapy configurations as well as the line source benchmark underline the efficiency of the proposed method.