The Curse of Passive Data Collection in Batch Reinforcement Learning. In high stake applications, active experimentation may be considered too risky and thus data are often collected passively. While in simple cases, such as in bandits, passive and active data collection are similarly effective, the price of passive sampling can be much higher when collecting data from a system with controlled states. The main focus of the current paper is the characterization of this price. For example, when learning in episodic finite state action Markov decision processes (MDPs) with mathrm S states and mathrm A actions, we show that even with the best (but passively chosen) logging policy, Omega( mathrm A min( mathrm S 1, H) varepsilon 2) episodes are necessary (and sufficient) to obtain an epsilon optimal policy, where H is the length of episodes. Note that this shows that the sample complexity blows up exponentially compared to the case of active data collection, a result which is not unexpected, but, as far as we know, have not been published beforehand and perhaps the form of the exact expression is a little surprising. We also extend these results in various directions, such as other criteria or learning in the presence of function approximation, with similar conclusions. A remarkable feature of our result is the sharp characterization of the exponent that appears, which is critical for understanding what makes passive learning hard.


Commutativity of quantization with conic reduction for torus actions on compact CR manifolds. We define conic reduction X red for torus actions on the boundary X of a strictly pseudo convex domain and for a given weight nu labelling a unitary irreducible representation. There is a natural residual circle action on X red . We have two natural decompositions of the corresponding Hardy spaces H(X) and H(X red ) . The first one is given by the ladder of isotypes H(X) k nu , k in mathbb Z , the second one is given by the k th Fourier components H(X red ) k induced by the residual circle action. The aim of this paper is to prove that they are isomorphic. Furthermore, we sketch the proof of a similar result for spaces of (0, q) forms with L 2 coefficients when X is a CR manifold with non degenerate Levi curvature for k sufficiently large.


Prediction of Solar Radiation Using Artificial Neural Network. Most solar applications and systems can be reliably used to generate electricity and power in many homes and offices. Recently, there is an increase in many solar required systems that can be found not only in electricity generation but other applications such as solar distillation, water heating, heating of buildings, meteorology and producing solar conversion energy. Prediction of solar radiation is very significant in order to accomplish the previously mentioned objectives. In this paper, the main target is to present an algorithm that can be used to predict an hourly activity of solar radiation. Using a dataset that consists of temperature of air, time, humidity, wind speed, atmospheric pressure, direction of wind and solar radiation data, an Artificial Neural Network (ANN) model is constructed to effectively forecast solar radiation using the available weather forecast data. Two models are created to efficiently create a system capable of interpreting patterns through supervised learning data and predict the correct amount of radiation present in the atmosphere. The results of the two statistical indicators Mean Absolute Error (MAE) and Mean Squared Error (MSE) are performed and compared with observed and predicted data. These two models were able to generate efficient predictions with sufficient performance accuracy.


The Structure of Stable Codimension One Integral Varifolds near Classical Cones of Density mathbf frac 5 2 . Adapting the blow up arguments in cite simon1993cylindrical and cite wickramasekera2014general , we prove a C 1, alpha regularity theorem for stable codimension one integral n varifolds which are sufficiently close to a lq lq classical cone'' of density frac 5 2 , i.e., a stationary integral cone supported on at most 5 half hyperplanes meeting along a common (n 1) dimensional axis with density frac 5 2 at the origin. Our result is the first of its kind for non flat cones with multiplicity 1 when branch points are present in the nearby varifold. The only additional hypothesis necessary for our result is geometric ruling out singularities comprised of three C 1, alpha hypersurfaces with boundary meeting (only) along their common boundary the corresponding results when the density of the classical cone is frac 3 2 or 2 in which case the cone has multiplicity one almost everywhere have been previously established in cite simon1993cylindrical and cite wick2021 respectively. For such varifolds the present work completes the analysis of the singular set in the region where the density is 3 , up to a set which is countably (n 2) rectifiable. A key new ingredient in our work is establishing a C 1, alpha boundary regularity theory for two valued C 1, alpha harmonic functions which arise as blow ups of sequences of such varifolds this is discussed more generally in the accompanying work cite minter2021 . Subject to appropriate conditions on lower density classical singularities and (expected) regularity theorems concerning lower density branch point singularities, our arguments have the potential to be iterated inductively to establish regularity results for stable codimension one integral varifolds near classical cones of density q frac 1 2 at the origin.


Truthful allocation in graphs and hypergraphs. We study truthful mechanisms for allocation problems in graphs, both for the minimization (i.e., scheduling) and maximization (i.e., auctions) setting. The minimization problem is a special case of the well studied unrelated machines scheduling problem, in which every given task can be executed only by two pre specified machines in the case of graphs or a given subset of machines in the case of hypergraphs. This corresponds to a multigraph whose nodes are the machines and its hyperedges are the tasks. This class of problems belongs to multidimensional mechanism design, for which there are no known general mechanisms other than the VCG and its generalization to affine minimizers. We propose a new class of mechanisms that are truthful and have significantly better performance than affine minimizers in many settings. Specifically, we provide upper and lower bounds for truthful mechanisms for general multigraphs, as well as special classes of graphs such as stars, trees, planar graphs, k degenerate graphs, and graphs of a given treewidth. We also consider the objective of minimizing or maximizing the L p norm of the values of the players, a generalization of the makespan minimization that corresponds to p infty , and extend the results to any p 0 .


Common Sense Knowledge, Ontology and Text Mining for Implicit Requirements. The ability of a system to meet its requirements is a strong determinant of success. Thus effective requirements specification is crucial. Explicit Requirements are well defined needs for a system to execute. IMplicit Requirements (IMRs) are assumed needs that a system is expected to fulfill though not elicited during requirements gathering. Studies have shown that a major factor in the failure of software systems is the presence of unhandled IMRs. Since relevance of IMRs is important for efficient system functionality, there are methods developed to aid the identification and management of IMRs. In this paper, we emphasize that Common Sense Knowledge, in the field of Knowledge Representation in AI, would be useful to automatically identify and manage IMRs. This paper is aimed at identifying the sources of IMRs and also proposing an automated support tool for managing IMRs within an organizational context. Since this is found to be a present gap in practice, our work makes a contribution here. We propose a novel approach for identifying and managing IMRs based on combining three core technologies common sense knowledge, text mining and ontology. We claim that discovery and handling of unknown and non elicited requirements would reduce risks and costs in software development.


Controllability of vertex delay type problems by the regular linear systems approach. In this paper, we are interested in the concept of controllability for a class of transport processes on infinite metric graphs with a delay term at the boundary conditions. Using the feedback theory of well posed and regular linear systems of infinite dimension, we provide the necessary and sufficient conditions for the approximate controllability of such systems. Starting from these conditions, we characterize the approximate controllability in terms of an algebraic property of the coefficients of the system. Moreover, we prove that this property coincides with the usual Kalman controllability criterion in the case of a finite graph. Furthermore, we show that the controllability of a given transport process on a finite graph is equivalent to the structural controllability of a linear control system of finite dimension.


Online Adversarial Attacks. Adversarial attacks expose important vulnerabilities of deep learning models, yet little attention has been paid to settings where data arrives as a stream. In this paper, we formalize the online adversarial attack problem, emphasizing two key elements found in real world use cases attackers must operate under partial knowledge of the target model, and the decisions made by the attacker are irrevocable since they operate on a transient data stream. We first rigorously analyze a deterministic variant of the online threat model by drawing parallels to the well studied k secretary problem in theoretical computer science and propose Virtual , a simple yet practical online algorithm. Our main theoretical result shows Virtual yields provably the best competitive ratio over all single threshold algorithms for k 5 extending the previous analysis of the k secretary problem. We also introduce the textit stochastic k secretary effectively reducing online blackbox transfer attacks to a k secretary problem under noise and prove theoretical bounds on the performance of Virtual adapted to this setting. Finally, we complement our theoretical results by conducting experiments on MNIST, CIFAR 10, and Imagenet classifiers, revealing the necessity of online algorithms in achieving near optimal performance and also the rich interplay between attack strategies and online attack selection, enabling simple strategies like FGSM to outperform stronger adversaries.


The Marcinkiewicz Zygmund Type Strong Law of Large Numbers with General Normalizing Sequences. This paper establishes complete convergence for weighted sums and the Marcinkiewicz Zygmund type strong law of large numbers for sequences of negatively associated and identically distributed random variables X,X n,n ge1 with general normalizing constants under a moment condition that ER(X) infty , where R( cdot) is a regularly varying function. The result is new even when the random variables are independent and identically distributed (i.i.d.), and a special case of this result comes close to a solution to an open question raised by Chen and Sung (Statist Probab Lett 92 45 52, 2014). The proof exploits some properties of slowly varying functions and the de Bruijin conjugates. A counterpart of the main result obtained by Martikainen (J Math Sci 75(5) 1944 1946, 1995) on the Marcinkiewicz Zygmund type strong law of large numbers for pairwise i.i.d. random variables is also presented. Two illustrated examples are provided, including a strong law of large numbers for pairwise negatively dependent random variables which have the same distribution as the random variable appearing in the St. Petersburg game.


Taming chaos with active grids Reproducibility in turbulent wind tunnel experiments. A wind tunnel experiment is shown to examine the reproducibility of generated wind fields in the laboratory utilizing an active grid. A motion protocol of the grid, designed to mimic a measured atmospheric wind speed time series, is therefore repeated 50 times and the flow is measured by a 2D hotwire (x wire) system. The acquired wind speed time series are analysed in two different ways to identify the reproducible time scales. A direct comparison using the cross covariance function combined with two filtering methods and a statistic approach using one and two point analysis. Like that the reproducible time and length scales could be linked to the active grid motion and design. The identification of the reproducible time scales of a turbulent signal generated by means of an active grid is suitable to improve the possible wind fields in laboratory experiments.


Recurrent Model Free RL can be a Strong Baseline for Many POMDPs. Many problems in RL, such as meta RL, robust RL, and generalization in RL, can be cast as POMDPs. In theory, simply augmenting model free RL with memory based architectures, such as recurrent neural networks, provides a general approach to solving all types of POMDPs. However, prior work has found that such recurrent model free RL methods tend to perform worse than more specialized algorithms that are designed for specific types of POMDPs. This paper revisits this claim. We find that careful architecture and hyperparameter decisions can often yield a recurrent model free implementation that performs on par with (and occasionally substantially better than) more sophisticated recent techniques. We compare to 19 environments from 5 prior specialized methods and find that our implementation achieves greater sample efficiency and asymptotic performance than these methods on 16 19 environments. We also release a simple and efficient implementation of recurrent model free RL for future work to use as a baseline for POMDPs.


Bipartite Graft II Cathedral Decomposition for Combs. We provide a canonical decomposition for a class of bipartite grafts known as combs. As every bipartite graft is a recursive combination of combs, our results provides a canonical decomposition for general bipartite grafts. Our new decomposition is by definition a generalization of the classical canonical decomposition in matching theory, that is, the Dulmage Mendelsohn decomposition for bipartite graphs with perfect matchings. However, it exhibits much more complicated structure than its classical counterpart. It is revealed from our results that bipartite grafts has a canonical structure that is analogous to the cathedral decomposition for nonbipartite graphs with perfect matchings.


CloneBot Personalized Dialogue Response Predictions. Our project task was to create a model that, given a speaker ID, chat history, and an utterance query, can predict the response utterance in a conversation. The model is personalized for each speaker. This task can be a useful tool for building speech bots that talk in a human like manner in a live conversation. Further, we succeeded at using dense vector encoding clustering to be able to retrieve relevant historical dialogue context, a useful strategy for overcoming the input limitations of neural based models when predictions require longer term references from the dialogue history. In this paper, we have implemented a state of the art model using pre training and fine tuning techniques built on transformer architecture and multi headed attention blocks for the Switchboard corpus. We also show how efficient vector clustering algorithms can be used for real time utterance predictions that require no training and therefore work on offline and encrypted message histories.


Stability and error analysis of a class of high order IMEX schemes for Navier stokes equations with periodic boundary conditions. We construct high order semi discrete in time and fully discrete (with Fourier Galerkin in space) schemes for the incompressible Navier Stokes equations with periodic boundary conditions, and carry out corresponding error analysis. The schemes are of implicit explicit type based on a scalar auxiliary variable (SAV) approach. It is shown that numerical solutions of these schemes are uniformly bounded without any restriction on time step size. These uniform bounds enable us to carry out a rigorous error analysis for the schemes up to fifth order in a unified form, and derive global error estimates in l infty(0,T H 1) cap l 2(0,T H 2) in the two dimensional case as well as local error estimates in l infty(0,T H 1) cap l 2(0,T H 2) in the three dimensional case. We also present numerical results confirming our theoretical convergence rates and demonstrating advantages of higher order schemes for flows with complex structures in the double shear layer problem.


Fractals on a benchtop Observing fractal dimension in a resistor network. Our first experience of dimension typically comes in the intuitive Euclidean sense a line is one dimensional, a plane is two dimensional, and a volume is three dimensional. However, following the work of Mandelbrot cite mandelbrot , systems with a fractional dimension, fractals'', now play an important role in science. The novelty of encountering fractional dimension, and the intrinsic beauty of many fractals, have a strong appeal to students and provide a powerful teaching tool. I describe here a low cost and convenient experimental method for observing fractal dimension, by measuring the power law scaling of the resistance of a fractal network of resistors. The experiments are quick to perform, and the students enjoy both the construction of the network and the collaboration required to create the largest networks. Learning outcomes include analysis of resistor networks beyond the elementary series and parallel combinations, scaling laws, and an introduction to fractional dimension.


Lower Bounds for Differentially Private ERM Unconstrained and Non Euclidean. We consider the lower bounds of differentially private empirical risk minimization (DP ERM) for convex functions in constrained unconstrained cases with respect to the general ell p norm beyond the ell 2 norm considered by most of the previous works. We provide a simple black box reduction approach which can generalize lower bounds in constrained case to unconstrained case. For ( epsilon, delta) DP, we achieve Omega( frac sqrt d log(1 delta) epsilon n ) lower bounds for both constrained and unconstrained cases and any ell p geometry where p geq 1 by introducing a novel biased mean property for fingerprinting codes, where n is the size of the data set and d is the dimension.


Invariant Measure for Neutral Stochastic Functional Differential Equations with Non Lipschitz Coefficients. In this work we study the long time behavior of nonlinear stochastic functional differential equations of neutral type in Hilbert spaces with non Lipschitz nonlinearities. We establish the existence of invariant measures in the shift spaces for such equations. Our approach is based on Krylov Bogoliubov theorem on the tightness of the family of measures.


ThetA fast and robust clustering via a distance parameter. Clustering is a fundamental problem in machine learning where distance based approaches have dominated the field for many decades. This set of problems is often tackled by partitioning the data into K clusters where the number of clusters is chosen apriori. While significant progress has been made on these lines over the years, it is well established that as the number of clusters or dimensions increase, current approaches dwell in local minima resulting in suboptimal solutions. In this work, we propose a new set of distance threshold methods called Theta based Algorithms (ThetA). Via experimental comparisons and complexity analyses we show that our proposed approach outperforms existing approaches in a) clustering accuracy and b) time complexity. Additionally, we show that for a large class of problems, learning the optimal threshold is straightforward in comparison to learning K. Moreover, we show how ThetA can infer the sparsity of datasets in higher dimensions.


Contrastive Domain Adaptation for Question Answering using Limited Text Corpora. Question generation has recently shown impressive results in customizing question answering (QA) systems to new domains. These approaches circumvent the need for manually annotated training data from the new domain and, instead, generate synthetic question answer pairs that are used for training. However, existing methods for question generation rely on large amounts of synthetically generated datasets and costly computational resources, which render these techniques widely inaccessible when the text corpora is of limited size. This is problematic as many niche domains rely on small text corpora, which naturally restricts the amount of synthetic data that can be generated. In this paper, we propose a novel framework for domain adaptation called contrastive domain adaptation for QA (CAQA). Specifically, CAQA combines techniques from question generation and domain invariant learning to answer out of domain questions in settings with limited text corpora. Here, we train a QA system on both source data and generated data from the target domain with a contrastive adaptation loss that is incorporated in the training objective. By combining techniques from question generation and domain invariant learning, our model achieved considerable improvements compared to state of the art baselines.


An upper bound for p c in range R bond percolation in two and three dimensions. An upper bound for the critical probability of long range bond percolation in d 2 and d 3 is obtained by connecting the bond percolation with the SIR epidemic model, thus complementing the lower bound result in Frei and Perkins arXiv arch ive 1603.04130. A key ingredient is that we establish a uniform bound for the local times of branching random walk by calculating their exponential moments and by using the discrete versions of Tanaka's formula and Garsia's Lemma.


On the Stable category of maximal Cohen Macaulay modules over Gorenstein rings I. Let (A, mathfrak m ) be a Gorenstein local ring and let CMS(A) be its stable category of maximal CM A modules. Suppose CMS(A) cong CMS(B) as triangulated categories. Then we show (1) If A is a complete intersection of codimension c then so is B . (2) If A, B are Henselian and not hypersurfaces then dim A dim B . (3) If A, B are Henselian and A is an isolated singularity then so is B . We also give some applications of our results.


Is Stance Detection Topic Independent and Cross topic Generalizable? A Reproduction Study. Cross topic stance detection is the task to automatically detect stances (pro, against, or neutral) on unseen topics. We successfully reproduce state of the art cross topic stance detection work (Reimers et. al., 2019), and systematically analyze its reproducibility. Our attention then turns to the cross topic aspect of this work, and the specificity of topics in terms of vocabulary and socio cultural context. We ask To what extent is stance detection topic independent and generalizable across topics? We compare the model's performance on various unseen topics, and find topic (e.g. abortion, cloning), class (e.g. pro, con), and their interaction affecting the model's performance. We conclude that investigating performance on different topics, and addressing topic specific vocabulary and context, is a future avenue for cross topic stance detection.


An Improved Authentication Key Exchange Protocol Based on ECDH for WSNs. The widespread use of wireless sensor networks (WSNs) that are consisted of resource constrained sensor nodes in communication with gateways in open space environments and industries has highlighted the need for a secure yet fast communication protocol between users, gateways, and sensor nodes. Due to the properties of the network, elliptic curve cryptography seems to be the most viable choice as it requires fewer resources than most other options. In this paper, we analyze the protocol suggested by Moghadam et al. which is based on ECDH (elliptic curve Diffie Hellman), and mention some of the flaws in their proposed authentication and key exchange protocol. Some attacks are also mentioned to further explain the shortcomings of their schema. Then a modified version of the protocol is proposed, analyzed, and checked against the same attacks as an informal security proof.


How many years can a tiny unbalanced parenthesis go unnoticed on a widely accessed Internet document, older than the World Wide Web itself ?. We conducted an investigation to find when a mistake was introduced in a widely accessed Internet document, namely the RFC index. With great surprise, we discovered that a it may go unnoticed for a very long period, namely more that twenty six years. This raises some questions to what does it mean to have open access and the meaning of Linus' laws that "given enough eyeballs, all bugs are shallow"


High degeneracy Potts coarsening. I examine the fate of a kinetic Potts ferromagnet with a high ground state degeneracy that undergoes a deep quench to zero temperature. I consider single spin flip dynamics on triangular lattices of linear dimension 8 le L le 128 and set the number of spin states q equal to the number of lattice sites L times L . The ground state is the most abundant final state, and is reached with probability approx 0.71 . Three hexagon states occur with probability approx 0.26 , and hexagonal tessellations with more than three clusters form with probabilities of mathcal O (10 3 ) or less. Spanning stripe states where the domain walls run along one of the three lattice directions appear with probability approx 0.03 . "Blinker" configurations, which contain perpetually flippable spins, also emerge, but with a probability that is vanishingly small with the system size.


Visuality in a Cross disciplinary Battleground Analysis of Inscriptions in Digital Humanities Journal Publications. Like the old saying, "a graph is worth a thousand words," the non verbal language, encapsulated in the concept of inscription, is a fundamental rhetorical device in the construction of knowledge represented by research outputs. As many inscriptions are deeply situated in a scientific and data driven research paradigm, they can be used to understand the relationships between research traditions involved in the field of digital humanities (DH), a highly cross disciplinary field that is frequently regarded as a battleground between these distinct research traditions, especially the humanities and STEM fields. This paper presents a quantitative, community focused examination of how inscriptions are used in English language research articles in DH journals. We randomly selected 252 articles published between 2011 and 2020 from a representative DH journal list, and manually coded and classified inscriptions and author domains in these publications. We found that inscriptions have been increasingly used during the past decade and their uses are more intensive in publications led by STEM authors comparing to other domains. This study offers a timely survey of the disciplinary landscape of DH from the perspective of inscriptions and sheds light on how different research approaches collaborated and combated in the field of DH.


Advances in Multi turn Dialogue Comprehension A Survey. Training machines to understand natural language and interact with humans is an elusive and essential task of artificial intelligence. A diversity of dialogue systems has been designed with the rapid development of deep learning techniques, especially the recent pre trained language models (PrLMs). Among these studies, the fundamental yet challenging type of task is dialogue comprehension whose role is to teach the machines to read and comprehend the dialogue context before responding. In this paper, we review the previous methods from the technical perspective of dialogue modeling for the dialogue comprehension task. We summarize the characteristics and challenges of dialogue comprehension in contrast to plain text reading comprehension. Then, we discuss three typical patterns of dialogue modeling. In addition, we categorize dialogue related pre training techniques which are employed to enhance PrLMs in dialogue scenarios. Finally, we highlight the technical advances in recent years and point out the lessons from the empirical analysis and the prospects towards a new frontier of researches.


A growth model for water distribution networks with loops. Water distribution networks (WDNs) expand their service areas over time. These growth dynamics are poorly understood. One facet of WDNs is that they have loops in general, and closing loops may be a functionally important process for enhancing their robustness and efficiency. We propose a growth model for WDNs that generates networks with loops and is applicable to networks with multiple water sources. We apply the proposed model to four empirical WDNs to show that it produces networks whose structure is similar to that of the empirical WDNs. The comparison between the empirical and modelled WDNs suggests that the empirical WDNs may realize a reasonable balance between cost, efficiency and robustness in terms of the network structure. We also study the design of pipe diameters based on a biological positive feedback mechanism. Specifically, we apply a model inspired by Physarum polycephalum to find moderate positive correlations between the empirical and modelled pipe diameters. The difference between the empirical and modelled pipe diameters suggests that we may be able to improve the performance of WDNs by following organizing principles of biological flow networks.


Algebraic cycles and intersections of a quadric and a cubic. Let Y be a smooth complete intersection of a quadric and a cubic in mathbb P n , with n even. We show that Y has a multiplicative Chow K "unneth decomposition, in the sense of Shen Vial. As a consequence, the Chow ring of (powers of) Y displays K3 like behaviour. As a by product of the argument, we also establish a multiplicative Chow K "unneth decomposition for the resolution of singularities of a general nodal cubic hypersurface of even dimension.


Inference Systems with Corules for Combined Safety and Liveness Properties of Binary Session Types. Many properties of communication protocols combine safety and liveness aspects. Characterizing such combined properties by means of a single inference system is difficult because of the fundamentally different techniques (coinduction and induction, respectively) usually involved in defining and proving them. In this paper we show that Generalized Inference Systems allow us to obtain sound and complete characterizations of (at least some of) these combined inductive coinductive properties of binary session types. In particular, we illustrate the role of corules in characterizing fair termination (the property of protocols that can always eventually terminate), fair compliance (the property of interactions that can always be extended to reach client satisfaction) and fair subtyping, a liveness preserving refinement relation for session types. The characterizations we obtain are simpler compared to the previously available ones and corules provide insight on the liveness properties being ensured or preserved. Moreover, we can conveniently appeal to the bounded coinduction principle to prove the completeness of the provided characterizations.


On the Pythagoras number of the simplest cubic fields. The simplest cubic fields mathbb Q ( rho) are generated by a root rho of the polynomial x 3 ax 2 (a 3)x 1 where a geq 1 . In this paper, we will show that the Pythagoras number of the order mathbb Z rho is equal to 6 for a geq 3 .


Minimum Scan Cover and Variants Theory and Experiments. We consider a spectrum of geometric optimization problems motivated by contexts such as satellite communication and astrophysics. In the problem Minimum Scan Cover with Angular Costs, we are given a graph G that is embedded in Euclidean space. The edges of G need to be scanned, i.e., probed from both of their vertices. In order to scan their edge, two vertices need to face each other changing the heading of a vertex incurs some cost in terms of energy or rotation time that is proportional to the corresponding rotation angle. Our goal is to compute schedules that minimize the following objective functions (i) in Minimum Makespan Scan Cover (MSC MS), this is the time until all edges are scanned (ii) in Minimum Total Energy Scan Cover (MSC TE), the sum of all rotation angles (iii) in Minimum Bottleneck Energy Scan Cover (MSC BE), the maximum total rotation angle at one vertex. Previous theoretical work on MSC MS revealed a close connection to graph coloring and the cut cover problem, leading to hardness and approximability results. In this paper, we present polynomial time algorithms for 1D instances of MSC TE and MSC BE, but NP hardness proofs for bipartite 2D instances. For bipartite graphs in 2D, we also give 2 approximation algorithms for both MSC TE and MSC BE. Most importantly, we provide a comprehensive study of practical methods for all three problems. We compare three different mixed integer programming and two constraint programming approaches, and show how to compute provably optimal solutions for geometric instances with up to 300 edges. Additionally, we compare the performance of different meta heuristics for even larger instances.


Frank Wolfe and friends a journey into projection free first order optimization methods. Invented some 65 years ago in a seminal paper by Marguerite Straus Frank and Philip Wolfe, the Frank Wolfe method recently enjoys a remarkable revival, fuelled by the need of fast and reliable first order optimization methods in Data Science and other relevant application areas. This review tries to explain the success of this approach by illustrating versatility and applicability in a wide range of contexts, combined with an account on recent progress in variants, both improving on the speed and efficiency of this surprisingly simple principle of first order optimization.


Total positivity of some polynomial matrices that enumerate labeled trees and forests, I. Forests of rooted labeled trees. We consider the lower triangular matrix of generating polynomials that enumerate k component forests of rooted trees on the vertex set n according to the number of improper edges (generalizations of the Ramanujan polynomials). We show that this matrix is coefficientwise totally positive and that the sequence of its row generating polynomials is coefficientwise Hankel totally positive. More generally, we define the generic rooted forest polynomials by introducing also a weight m! , phi m for each vertex with m proper children. We show that if the weight sequence phi is Toeplitz totally positive, then the two foregoing total positivity results continue to hold. Our proofs use production matrices and exponential Riordan arrays.


Analytical approach to the generalized friendship paradox in networks with correlated attributes. One of the interesting phenomena due to the topological heterogeneities in complex networks is the friendship paradox, stating that your friends have on average more friends than you do. Recently, this paradox has been generalized for arbitrary nodal attributes, called a generalized friendship paradox (GFP). In this paper, we analyze the GFP for the networks in which the attributes of neighboring nodes are correlated with each other. The correlation structure between attributes of neighboring nodes is modeled by the Farlie Gumbel Morgenstern copula, enabling us to derive approximate analytical solutions of the GFP for three kinds of methods summarizing the neighborhood of the focal node, i.e., mean based, median based, and fraction based methods. The analytical solutions are comparable to simulation results, while some systematic deviations between them might be attributed to the higher order correlations between nodal attributes. These results help us get deeper insight into how various summarization methods as well as the correlation structure of nodal attributes affect the GFP behavior, hence better understand various related phenomena in complex networks.


A multiagent based framework secured with layered SVM based IDS for remote healthcare systems. Since the number of elderly and patients who are in hospitals and healthcare centers are growing, providing efficient remote healthcare services seems very important. Currently, most such systems benefit from the distribution and autonomy features of multiagent systems and the structure of wireless sensor networks. On the one hand, securing the data of remote healthcare systems is one of the most significant concerns particularly recent types of research about the security of remote healthcare systems keep them secure from eavesdropping and data modification. On the other hand, existing remote healthcare systems are still vulnerable against other common attacks of healthcare networks such as Denial of Service (DoS) and User to Root (U2R) attacks, because they are managed remotely and based on the Internet. Therefore, in this paper, we propose a secure framework for remote healthcare systems that consists of two phases. First, we design a healthcare system base on multiagent technology to collect data from a sensor network. Then, in the second phase, a layered architecture of intrusion detection systems that uses Support Vector Machine to learn the behavior of network traffic is applied. Based on our framework, we implement a secure remote healthcare system and evaluate this system against the frequent attacks of healthcare networks such as Smurf, Buffer overflow, Neptune, and Pod attacks. In the end, evaluation parameters of the layered architecture of intrusion detection systems prove the efficiency and correctness of our proposed framework.


Teaching Model based Requirements Engineering to Industry Professionals An Experience Report. The use of conceptual models to foster requirements engineering has been proposed and evaluated as beneficial for several decades. For instance, goal oriented requirements engineering or the specification of scenarios are commonly done using conceptual models. Bringing such model based requirements engineering approaches into industrial practice typically requires industrial training. In this paper, we report lessons learned from a training program for teaching industry professionals model based requirements engineering. Particularly, we as educators and learners report experiences from designing the training program, conducting the actual training, and applying the instructed material in our day to day work. From these findings we provide guidelines for educators designing requirements engineering courses for industry professionals.


Dirichlet problem of complex Monge Amp ere equation near an isolated KLT singularity. We solve the Dirichlet Problem of Monge Amp ere equation near an isolate Klt singularity, which generalizes the result of Eyssidieux Guedj Zeriahi cite EGZ , where the Monge Amp ere equation is solved on singular varieties without boundary. As a corollary, we construct solutions to Monge Amp ere equation with isolated singularity on strongly pseudoconvex domain Omega contained in mathbb C n .


RetrievalFuse Neural 3D Scene Reconstruction with a Database. 3D reconstruction of large scenes is a challenging problem due to the high complexity nature of the solution space, in particular for generative neural networks. In contrast to traditional generative learned models which encode the full generative process into a neural network and can struggle with maintaining local details at the scene level, we introduce a new method that directly leverages scene geometry from the training database. First, we learn to synthesize an initial estimate for a 3D scene, constructed by retrieving a top k set of volumetric chunks from the scene database. These candidates are then refined to a final scene generation with an attention based refinement that can effectively select the most consistent set of geometry from the candidates and combine them together to create an output scene, facilitating transfer of coherent structures and local detail from train scene geometry. We demonstrate our neural scene reconstruction with a database for the tasks of 3D super resolution and surface reconstruction from sparse point clouds, showing that our approach enables generation of more coherent, accurate 3D scenes, improving on average by over 8 in IoU over state of the art scene reconstruction.


Breaking the Computation and Communication Abstraction Barrier in Distributed Machine Learning Workloads. Recent trend towards increasing large machine learning models require both training and inference tasks to be distributed. Considering the huge cost of training these models, it is imperative to unlock optimizations in computation and communication to obtain best performance. However, current logical separation between computation and communication kernels in deep learning frameworks misses the optimization opportunities across such barrier. Breaking this abstraction with a holistic consideration can provide many optimizations to provide performance improvements in distributed workloads. Manually applying these optimizations needs modifications in underlying computation and communication libraries for each scenario, which is time consuming and error prone. Therefore, we present CoCoNeT, with a DSL to express a program with both computation and communication. CoCoNeT contains several machine learning aware transformations to optimize a program and a compiler to generate high performance kernels. Providing both computation and communication as first class constructs allows users to work on a high level abstraction and apply powerful optimizations, such as fusion or overlapping of communication and computation. CoCoNeT enables us to optimize data , model and pipeline parallel workloads in large language models with only a few lines of code. Experiments show CoCoNeT significantly outperforms state of the art distributed machine learning implementations.


Error Correction for Sparse Support Recovery Algorithms. Consider the compressed sensing setup where the support s of an m sparse d dimensional signal x is to be recovered from n linear measurements with a given algorithm. Suppose that the measurements are such that the algorithm does not guarantee perfect support recovery and that true features may be missed. Can they efficiently be retrieved? This paper addresses this question through a simple error correction module referred to as LiRE. LiRE takes as input an estimate s in of the true support s , and outputs a refined support estimate s out . In the noiseless measurement setup, sufficient conditions are established under which LiRE is guaranteed to recover the entire support, that is s out contains s . These conditions imply, for instance, that in the high dimensional regime LiRE can correct a sublinear in m number of errors made by Orthogonal Matching Pursuit (OMP). The computational complexity of LiRE is O(mnd) . Experimental results with random Gaussian design matrices show that LiRE substantially reduces the number of measurements needed for perfect support recovery via Compressive Sampling Matching Pursuit, Basis Pursuit (BP), and OMP. Interestingly, adding LiRE to OMP yields a support recovery procedure that is more accurate and significantly faster than BP. This observation carries over in the noisy measurement setup. Finally, as a standalone support recovery algorithm with a random initialization, experiments show that LiRE's reconstruction performance lies between OMP and BP. These results suggest that LiRE may be used generically, on top of any suboptimal baseline support recovery algorithm, to improve support recovery or to operate with a smaller number of measurements, at the cost of a relatively small computational overhead. Alternatively, LiRE may be used as a standalone support recovery algorithm that is competitive with respect to OMP.


Compositional Transformers for Scene Generation. We introduce the GANformer2 model, an iterative object oriented transformer, explored for the task of generative modeling. The network incorporates strong and explicit structural priors, to reflect the compositional nature of visual scenes, and synthesizes images through a sequential process. It operates in two stages a fast and lightweight planning phase, where we draft a high level scene layout, followed by an attention based execution phase, where the layout is being refined, evolving into a rich and detailed picture. Our model moves away from conventional black box GAN architectures that feature a flat and monolithic latent space towards a transparent design that encourages efficiency, controllability and interpretability. We demonstrate GANformer2's strengths and qualities through a careful evaluation over a range of datasets, from multi object CLEVR scenes to the challenging COCO images, showing it successfully achieves state of the art performance in terms of visual quality, diversity and consistency. Further experiments demonstrate the model's disentanglement and provide a deeper insight into its generative process, as it proceeds step by step from a rough initial sketch, to a detailed layout that accounts for objects' depths and dependencies, and up to the final high resolution depiction of vibrant and intricate real world scenes. See https github.com dorarad gansformer for model implementation.


Decentralized Self Adaptive Systems A Mapping Study. With the increasing ubiquity and scale of self adaptive systems, there is a growing need to decentralize the functionality that realizes self adaptation. Our focus is on architecture based self adaptive systems where one or more functions for monitoring, analyzing, planning, and executing are realized by multiple components that coordinate with one another. While some earlier studies have shed light on existing work on the decentralization of self adaptive systems, there is currently no clear overview of the state of the art in decentralization of self adaptive systems. Yet, having a precise view on the state of the art in decentralized self adaptive systems is crucial for researchers to understand existing solutions and drive future research efforts. To address this gap, we conducted a mapping study. The study focused on papers published at 24 important venues that publish research on self adaptation. The study focused on the motivations for choosing a decentralized approach to realize self adaptation, the adaptation functions that are decentralized, the realization of the coordination, and the open challenges in the area.


Deep learning based parameter search for an agent based social network model. Interactions between humans give rise to complex social networks that are characterized by heterogeneous degree distribution, weight topology relation, overlapping community structure, and dynamics of links. Understanding such networks is a primary goal of science due to serving as the scaffold for many emergent social phenomena from disease spreading to political movements. An appropriate tool for studying them is agent based modeling, in which nodes, representing persons, make decisions about creating and deleting links, thus yielding various macroscopic behavioral patterns. Here we focus on studying a generalization of the weighted social network model, being one of the most fundamental agent based models for describing the formation of social ties and social networks. This Generalized Weighted Social Network (GWSN) model incorporates triadic closure, homophilic interactions, and various link termination mechanisms, which have been studied separately in the previous works. Accordingly, the GWSN model has an increased number of input parameters and the model behavior gets excessively complex, making it challenging to clarify the model behavior. We have executed massive simulations with a supercomputer and using the results as the training data for deep neural networks to conduct regression analysis for predicting the properties of the generated networks from the input parameters. The obtained regression model was also used for global sensitivity analysis to identify which parameters are influential or insignificant. We believe that this methodology is applicable for a large class of complex network models, thus opening the way for more realistic quantitative agent based modeling.


Multi Branch Deep Radial Basis Function Networks for Facial Emotion Recognition. Emotion recognition (ER) from facial images is one of the landmark tasks in affective computing with major developments in the last decade. Initial efforts on ER relied on handcrafted features that were used to characterize facial images and then feed to standard predictive models. Recent methodologies comprise end to end trainable deep learning methods that simultaneously learn both, features and predictive model. Perhaps the most successful models are based on convolutional neural networks (CNNs). While these models have excelled at this task, they still fail at capturing local patterns that could emerge in the learning process. We hypothesize these patterns could be captured by variants based on locally weighted learning. Specifically, in this paper we propose a CNN based architecture enhanced with multiple branches formed by radial basis function (RBF) units that aims at exploiting local information at the final stage of the learning process. Intuitively, these RBF units capture local patterns shared by similar instances using an intermediate representation, then the outputs of the RBFs are feed to a softmax layer that exploits this information to improve the predictive performance of the model. This feature could be particularly advantageous in ER as cultural ethnicity differences may be identified by the local units. We evaluate the proposed method in several ER datasets and show the proposed methodology achieves state of the art in some of them, even when we adopt a pre trained VGG Face model as backbone. We show it is the incorporation of local information what makes the proposed model competitive.


Application of Rothe's method to a nonlinear wave equation on graphs. We study a nonlinear wave equation on finite connected weighted graphs. Using Rothe's and energy methods, we prove the existence and uniqueness of solution under certain assumption. For linear wave equation on graphs, Lin and Xie cite Lin Xie obtained the existence and uniqueness of solution. The main novelty of this paper is that the wave equation we considered has the nonlinear damping term u t p 1 cdot u t ( p 1 ).


Pathdreamer A World Model for Indoor Navigation. People navigating in unfamiliar buildings take advantage of myriad visual, spatial and semantic cues to efficiently achieve their navigation goals. Towards equipping computational agents with similar capabilities, we introduce Pathdreamer, a visual world model for agents navigating in novel indoor environments. Given one or more previous visual observations, Pathdreamer generates plausible high resolution 360 visual observations (RGB, semantic segmentation and depth) for viewpoints that have not been visited, in buildings not seen during training. In regions of high uncertainty (e.g. predicting around corners, imagining the contents of an unseen room), Pathdreamer can predict diverse scenes, allowing an agent to sample multiple realistic outcomes for a given trajectory. We demonstrate that Pathdreamer encodes useful and accessible visual, spatial and semantic knowledge about human environments by using it in the downstream task of Vision and Language Navigation (VLN). Specifically, we show that planning ahead with Pathdreamer brings about half the benefit of looking ahead at actual observations from unobserved parts of the environment. We hope that Pathdreamer will help unlock model based approaches to challenging embodied navigation tasks such as navigating to specified objects and VLN.


Numerical solution of a matrix integral equation arising in Markov Modulated L 'evy processes. Markov modulated L 'evy processes lead to matrix integral equations of the kind A 0 A 1X A 2 X 2 A 3(X) 0 where A 0 , A 1 , A 2 are given matrix coefficients, while A 3(X) is a nonlinear function, expressed in terms of integrals involving the exponential of the matrix X itself. In this paper we propose some numerical methods for the solution of this class of matrix equations, perform a theoretical convergence analysis and show the effectiveness of the new methods by means of a wide numerical experimentation.


DeHumor Visual Analytics for Decomposing Humor. Despite being a critical communication skill, grasping humor is challenging a successful use of humor requires a mixture of both engaging content build up and an appropriate vocal delivery (e.g., pause). Prior studies on computational humor emphasize the textual and audio features immediately next to the punchline, yet overlooking longer term context setup. Moreover, the theories are usually too abstract for understanding each concrete humor snippet. To fill in the gap, we develop DeHumor, a visual analytical system for analyzing humorous behaviors in public speaking. To intuitively reveal the building blocks of each concrete example, DeHumor decomposes each humorous video into multimodal features and provides inline annotations of them on the video script. In particular, to better capture the build ups, we introduce content repetition as a complement to features introduced in theories of computational humor and visualize them in a context linking graph. To help users locate the punchlines that have the desired features to learn, we summarize the content (with keywords) and humor feature statistics on an augmented time matrix. With case studies on stand up comedy shows and TED talks, we show that DeHumor is able to highlight various building blocks of humor examples. In addition, expert interviews with communication coaches and humor researchers demonstrate the effectiveness of DeHumor for multimodal humor analysis of speech content and vocal delivery.


Redefining measures of Layered Architecture. Layered architecture represents the software structure in the form of layers. Every element in the software is assigned to one of the layers such that the relationship amongst the elements is maintained. A set of design principles rules the process of construction of the layered architecture. Various statistical measures have been defined to check whether the layered architecture of a given software is following these design principles or not. In this paper, we redefine the measures of layered architecture based on the relationship between the software components. The measures check for the violations committed regarding the back calls, skip calls, and cyclic structures. Further, we also introduce a new measure to verify the logical separation amongst the layers. The system's current architecture is extracted from the source code and represented using a three tier layered structure, which is the defacto standard architecture of Java applications. The redefined measures are applied to determine the conformance of layering principles in the system. We evaluate five different software systems for their architecture consistency. The results obtained on our redefined measures are compared to those obtained by applying the standard set of measures. A quantitative analysis of the proposed measures is performed, and we conclude that they can determine the consideration of layering principles followed during the development of a software system.


Investigation of a submerged fully passive energy extracting flapping foil operating in sheared inflow. In this work a fully passive energy harvesting foil is studied computationally. An in house 2nd order finite volume CFD solver, MaPFlow, is strongly coupled with a rigid body dynamics solver to investigate the foil operation under uniform and sheared inflow conditions with without free surface. The mesh follows the airfoil motion using a radial basis function (RBF) mesh deformation approach. Initially, MaPFlow predictions are compared to experimental and numerical results available in the literature, where reasonable agreement is found. Next, one phase simulations are considered for linearly sheared inflow for various shear rates. Results suggested that foil performance can be enhanced under sheared inflow conditions. Finally, two phase simulations taking into account the free surface, for both uniform and sheared inflow, are considered. Predictions indicate a significant deterioration in performance of the system when the foil operates under the free surface due to the interaction of the shed vorticity with the free surface.


Topology Preserved Human Reconstruction with Details. It is challenging to directly estimate the human geometry from a single image due to the high diversity and complexity of body shapes with the various clothing styles. Most of model based approaches are limited to predict the shape and pose of a minimally clothed body with over smoothing surface. While capturing the fine detailed geometries, the model free methods are lack of the fixed mesh topology. To address these issues, we propose a novel topology preserved human reconstruction approach by bridging the gap between model based and model free human reconstruction. We present an end to end neural network that simultaneously predicts the pixel aligned implicit surface and an explicit mesh model built by graph convolutional neural network. Experiments on DeepHuman and our collected dataset showed that our approach is effective. The code will be made publicly available.


Differential geometry of mathsf SO ast(2n) type structures. We study 4n dimensional smooth manifolds admitting a mathsf SO (2n) or a mathsf SO (2n) mathsf Sp (1) structure, where mathsf SO (2n) is the quaternionic real form of mathsf SO (2n, mathbb C ) . We show that such G structures, called almost hypercomplex quaternionic skew Hermitian structures, form the symplectic analogue of the better known almost hypercomplex quaternionic Hermitian structures (hH qH for short). We present several equivalent definitions of mathsf SO (2n) and mathsf SO (2n) mathsf Sp (1) structures in terms of almost symplectic forms compatible with an almost hypercomplex quaternionic structure, a quaternionic skew Hermitian form, or a symmetric 4 tensor, the latter establishing the counterpart of the fundamental 4 form in almost hH qH geometries. The intrinsic torsion of such structures is presented in terms of Salamon's mathsf E mathsf H formalism, and the algebraic types of the corresponding geometries are classified. We construct explicit adapted connections to our G structures and specify certain normalization conditions, under which these connections become minimal. Finally, we present the classification of symmetric spaces K L with K semisimple admitting an invariant torsion free mathsf SO (2n) mathsf Sp (1) structure. This paper is the first in a series aiming at the description of the differential geometry of mathsf SO (2n) and mathsf SO (2n) mathsf Sp (1) structures.


LawSum A weakly supervised approach for Indian Legal Document Summarization. Unlike the courts in western countries, public records of Indian judiciary are completely unstructured and noisy. No large scale publicly available annotated datasets of Indian legal documents exist till date. This limits the scope for legal analytics research. In this work, we propose a new dataset consisting of over 10,000 judgements delivered by the supreme court of India and their corresponding hand written summaries. The proposed dataset is pre processed by normalising common legal abbreviations, handling spelling variations in named entities, handling bad punctuations and accurate sentence tokenization. Each sentence is tagged with their rhetorical roles. We also annotate each judgement with several attributes like date, names of the plaintiffs, defendants and the people representing them, judges who delivered the judgement, acts statutes that are cited and the most common citations used to refer the judgement. Further, we propose an automatic labelling technique for identifying sentences which have summary worthy information. We demonstrate that this auto labeled data can be used effectively to train a weakly supervised sentence extractor with high accuracy. Some possible applications of this dataset besides legal document summarization can be in retrieval, citation analysis and prediction of decisions by a particular judge.


A causal learning framework for the analysis and interpretation of COVID 19 clinical data. We present a workflow for clinical data analysis that relies on Bayesian Structure Learning (BSL), an unsupervised learning approach, robust to noise and biases, that allows to incorporate prior medical knowledge into the learning process and that provides explainable results in the form of a graph showing the causal connections among the analyzed features. The workflow consists in a multi step approach that goes from identifying the main causes of patient's outcome through BSL, to the realization of a tool suitable for clinical practice, based on a Binary Decision Tree (BDT), to recognize patients at high risk with information available already at hospital admission time. We evaluate our approach on a feature rich COVID 19 dataset, showing that the proposed framework provides a schematic overview of the multi factorial processes that jointly contribute to the outcome. We discuss how these computational findings are confirmed by current understanding of the COVID 19 pathogenesis. Further, our approach yields to a highly interpretable tool correctly predicting the outcome of 85 of subjects based exclusively on 3 features age, a previous history of chronic obstructive pulmonary disease and the PaO2 FiO2 ratio at the time of arrival to the hospital. The inclusion of additional information from 4 routine blood tests (Creatinine, Glucose, pO2 and Sodium) increases predictive accuracy to 94.5 .


Connected Coordinated Motion Planning with Bounded Stretch. We consider the problem of coordinated motion planning for a swarm of simple, identical robots From a given start grid configuration of robots, we need to reach a desired target configuration via a sequence of parallel, continuous, collision free robot motions, such that the set of robots induces a connected grid graph at all integer times. The objective is to minimize the makespan of the motion schedule, i.e., to reach the new configuration in a minimum amount of time. We show that this problem is NP hard, even for deciding whether a makespan of 2 can be achieved, while it is possible to check in polynomial time whether a makespan of 1 can be achieved. On the algorithmic side, we establish simultaneous constant factor approximation for two fundamental parameters, by achieving constant stretch for constant scale. Scaled shapes (which arise by increasing all dimensions of a given object by the same multiplicative factor) have been considered in previous seminal work on self assembly, often with unbounded or logarithmic scale factors we provide methods for a generalized scale factor, bounded by a constant. Moreover, our algorithm achieves a constant stretch factor If mapping the start configuration to the target configuration requires a maximum Manhattan distance of d , then the total duration of our overall schedule is O(d) , which is optimal up to constant factors.


PartImageNet A Large, High Quality Dataset of Parts. It is natural to represent objects in terms of their parts. This has the potential to improve the performance of algorithms for object recognition and segmentation but can also help for downstream tasks like activity recognition. Research on part based models, however, is hindered by the lack of datasets with per pixel part annotations. This is partly due to the difficulty and high cost of annotating object parts so it has rarely been done except for humans (where there exists a big literature on part based models). To help address this problem, we propose PartImageNet, a large, high quality dataset with part segmentation annotations. It consists of 158 classes from ImageNet with approximately 24,000 images. PartImageNet is unique because it offers part level annotations on a general set of classes including non rigid, articulated objects, while having an order of magnitude larger size compared to existing part datasets (excluding datasets of humans). It can be utilized for many vision tasks including Object Segmentation, Semantic Part Segmentation, Few shot Learning and Part Discovery. We conduct comprehensive experiments which study these tasks and set up a set of baselines. The dataset and scripts are released at https github.com TACJu PartImageNet.


H "older regularity of the Boltzmann equation past an obstacle. Regularity and singularity of the solutions according to the shape of domains is a challenging research theme in the Boltzmann theory ( cite Kim11,GKTT1 ). In this paper, we prove an optimal H "older regularity in C 0, frac 1 2 x,v for the Boltzmann equation of the hard sphere molecule, which undergoes the elastic reflection in the intermolecular collision and the contact with the boundary of a convex obstacle. In particular, this H "older regularity result is a stark contrast to the case of other physical boundary conditions (such as the diffuse reflection boundary condition and in flow boundary condition), for which the solutions of the Boltzmann equation develop discontinuity in a codimension 1 subset ( cite Kim11 ), and therefore the best possible regularity is BV, which has been proved in cite GKTT2 .


Quantifying local embeddings into finite groups. We study a function mathcal L Gamma which quantifies the LEF (local embeddability into finite groups) property for a finitely generated group Gamma . We compute this "LEF growth" function in some examples, including certain wreath products. We compare LEF growth with the analogous quantitative version of residual finiteness, and exhibit a family of finitely generated residually finite groups which nevertheless admit many more local embeddings into finite groups than they do finite quotients. Along the way, we give a new proof that B.H. Neumann's continuous family of 2 generated groups contains no finitely presented group, a result originally due to Baumslag and Miller. We compare mathcal L Gamma with quantitative versions of soficity and other metric approximation properties of groups. Finally, we show that there exists a "universal" function which is an upper bound on the LEF growth of any group on a given number of generators, and that (for non cyclic groups) any such function is non computable.


On the Number of Parts in Congruence Classes for Partitions into Distinct Parts. For integers 0 r leq t , let the function D r,t (n) denote the number of parts among all partitions of n into distinct parts that are congruent to r modulo t . We prove the asymptotic formula D r,t (n) sim dfrac 3 frac 14 e pi sqrt frac n 3 2 pi t n frac 14 left( log(2) left( dfrac sqrt 3 log(2) 8 pi dfrac pi 4 sqrt 3 left( r dfrac t 2 right) right) n frac 12 right) as n to infty . A corollary of this result is that for 0 r s leq t , the inequality D r,t (n) geq D s,t (n) holds for all sufficiently large n . We make this effective, showing that for 2 leq t leq 10 the inequality D r,t (n) geq D s,t (n) holds for all n 8 .


Short cycles in high genus unicellular maps. We study large uniform random maps with one face whose genus grows linearly with the number of edges, which are a model of discrete hyperbolic geometry. In previous works, several hyperbolic geometric features have been investigated. In the present work, we study the number of short cycles in a uniform unicellular map of high genus, and we show that it converges to a Poisson distribution. As a corollary, we obtain the law of the systole of uniform unicellular maps in high genus. We also obtain the asymptotic distribution of the vertex degrees in such a map.


Many to One Distribution Learning and K Nearest Neighbor Smoothing for Thoracic Disease Identification. Chest X rays are an important and accessible clinical imaging tool for the detection of many thoracic diseases. Over the past decade, deep learning, with a focus on the convolutional neural network (CNN), has become the most powerful computer aided diagnosis technology for improving disease identification performance. However, training an effective and robust deep CNN usually requires a large amount of data with high annotation quality. For chest X ray imaging, annotating large scale data requires professional domain knowledge and is time consuming. Thus, existing public chest X ray datasets usually adopt language pattern based methods to automatically mine labels from reports. However, this results in label uncertainty and inconsistency. In this paper, we propose many to one distribution learning (MODL) and K nearest neighbor smoothing (KNNS) methods from two perspectives to improve a single model's disease identification performance, rather than focusing on an ensemble of models. MODL integrates multiple models to obtain a soft label distribution for optimizing the single target model, which can reduce the effects of original label uncertainty. Moreover, KNNS aims to enhance the robustness of the target model to provide consistent predictions on images with similar medical findings. Extensive experiments on the public NIH Chest X ray and CheXpert datasets show that our model achieves consistent improvements over the state of the art methods.


Sharing Cognition Human Gesture and Natural Language Grounding Based Planning and Navigation for Indoor Robots. Cooperation among humans makes it easy to execute tasks and navigate seamlessly even in unknown scenarios. With our individual knowledge and collective cognition skills, we can reason about and perform well in unforeseen situations and environments. To achieve a similar potential for a robot navigating among humans and interacting with them, it is crucial for it to acquire the ability for easy, efficient and natural ways of communication and cognition sharing with humans. In this work, we aim to exploit human gestures which is known to be the most prominent modality of communication after the speech. We demonstrate how the incorporation of gestures for communicating spatial understanding can be achieved in a very simple yet effective way using a robot having the vision and listening capability. This shows a big advantage over using only Vision and Language based Navigation, Language Grounding or Human Robot Interaction in a task requiring the development of cognition and indoor navigation. We adapt the state of the art modules of Language Grounding and Human Robot Interaction to demonstrate a novel system pipeline in real world environments on a Telepresence robot for performing a set of challenging tasks. To the best of our knowledge, this is the first pipeline to couple the fields of HRI and language grounding in an indoor environment to demonstrate autonomous navigation.


The Many Dimensions of Truthfulness Crowdsourcing Misinformation Assessments on a Multidimensional Scale. Recent work has demonstrated the viability of using crowdsourcing as a tool for evaluating the truthfulness of public statements. Under certain conditions such as (1) having a balanced set of workers with different backgrounds and cognitive abilities (2) using an adequate set of mechanisms to control the quality of the collected data and (3) using a coarse grained assessment scale, the crowd can provide reliable identification of fake news. However, fake news are a subtle matter statements can be just biased ("cherrypicked"), imprecise, wrong, etc. and the unidimensional truth scale used in existing work cannot account for such differences. In this paper we propose a multidimensional notion of truthfulness and we ask the crowd workers to assess seven different dimensions of truthfulness selected based on existing literature Correctness, Neutrality, Comprehensibility, Precision, Completeness, Speaker's Trustworthiness, and Informativeness. We deploy a set of quality control mechanisms to ensure that the thousands of assessments collected on 180 publicly available fact checked statements distributed over two datasets are of adequate quality, including a custom search engine used by the crowd workers to find web pages supporting their truthfulness assessments. A comprehensive analysis of crowdsourced judgments shows that (1) the crowdsourced assessments are reliable when compared to an expert provided gold standard (2) the proposed dimensions of truthfulness capture independent pieces of information (3) the crowdsourcing task can be easily learned by the workers and (4) the resulting assessments provide a useful basis for a more complete estimation of statement truthfulness.


Anti Money Laundering Alert Optimization Using Machine Learning with Graphs. Money laundering is a global problem that concerns legitimizing proceeds from serious felonies (1.7 4 trillion euros annually) such as drug dealing, human trafficking, or corruption. The anti money laundering systems deployed by financial institutions typically comprise rules aligned with regulatory frameworks. Human investigators review the alerts and report suspicious cases. Such systems suffer from high false positive rates, undermining their effectiveness and resulting in high operational costs. We propose a machine learning triage model, which complements the rule based system and learns to predict the risk of an alert accurately. Our model uses both entity centric engineered features and attributes characterizing inter entity relations in the form of graph based features. We leverage time windows to construct the dynamic graph, optimizing for time and space efficiency. We validate our model on a real world banking dataset and show how the triage model can reduce the number of false positives by 80 while detecting over 90 of true positives. In this way, our model can significantly improve anti money laundering operations.


Twisted Hilbert schemes and division algebras. Let mathscr X S be any Severi Brauer scheme of constant relative dimension n over a Noetherian base scheme S . For each polynomial phi(t) in mathbb Q t , we construct a scheme mathrm Hilb phi(t) mathrm tw ( mathscr X S) that 'etale locally, on a cover S' S splitting mathscr X S , is the Hilbert scheme mathrm Hilb phi(t) ( mathscr X S' S') of the projective bundle mathscr X S' S' . We then study curves of small degree on a Severi Brauer variety in order to analyze examples. Our primary interest, in the case X is a Severi Brauer variety with index n 1 over a field k , is the subscheme mathrm Ell n(X) of mathrm Hilb mathrm tw nt (X k) parametrizing curves that are smooth, geometrically connected, and of genus 1.


On device Federated Learning with Flower. Federated Learning (FL) allows edge devices to collaboratively learn a shared prediction model while keeping their training data on the device, thereby decoupling the ability to do machine learning from the need to store data in the cloud. Despite the algorithmic advancements in FL, the support for on device training of FL algorithms on edge devices remains poor. In this paper, we present an exploration of on device FL on various smartphones and embedded devices using the Flower framework. We also evaluate the system costs of on device FL and discuss how this quantification could be used to design more efficient FL algorithms.


Fluid beam interaction Capturing the effect of embedded slender bodies on global fluid flow and vice versa. This work addresses research questions arising from the application of geometrically exact beam theory in the context of fluid structure interaction (FSI). Geometrically exact beam theory has proven to be a computationally efficient way to model the behavior of slender structures while leading to rather well posed problem descriptions. In particular, we propose a mixed dimensional embedded finite element approach for the coupling of one dimensional geometrically exact beam equations to a three dimensional background fluid mesh, referred to as fluid beam interaction (FBI) in analogy to the well established notion of FSI. Here, the fluid is described by the incompressible isothermal Navier Stokes equations for Newtonian fluids. In particular, we present algorithmic aspects regarding the solution of the resulting one way coupling schemes and, through selected numerical examples, analyze their spatial convergence behavior as well as their suitability not only as stand alone methods but also for an extension to a full two way coupling scheme.


How do exponential size solutions arise in semidefinite programming?. As a classic example of Khachiyan shows, some semidefinite programs (SDPs) have solutions whose size the number of bits necessary to describe them is exponential in the size of the input. Exponential size solutions are the main obstacle to solve a long standing open problem can we decide feasibility of SDPs in polynomial time? We prove that large solutions are actually quite common in SDPs a linear change of variables transforms every strictly feasible SDP into a Khachiyan type SDP, in which the leading variables are large. As to "how large", that depends on the singularity degree of a dual problem. Further, we present some SDPs in which large solutions appear naturally, without any change of variables. We also partially answer the question how do we represent such large solutions in polynomial space?


Investigating Effect of Dialogue History in Multilingual Task Oriented Dialogue Systems. While the English virtual assistants have achieved exciting performance with an enormous amount of training resources, the needs of non English speakers have not been satisfied well. Up to Dec 2021, Alexa, one of the most popular smart speakers around the world, is able to support 9 different languages 1 , while there are thousands of languages in the world, 91 of which are spoken by more than 10 million people according to statistics published in 2019 2 . However, training a virtual assistant in other languages than English is often more difficult, especially for those low resource languages. The lack of high quality training data restricts the performance of models, resulting in poor user satisfaction. Therefore, we devise an efficient and effective training solution for multilingual task orientated dialogue systems, using the same dataset generation pipeline and end to end dialogue system architecture as BiToD 5 , which adopted some key design choices for a minimalistic natural language design where formal dialogue states are used in place of natural language inputs. This reduces the room for error brought by weaker natural language models, and ensures the model can correctly extract the essential slot values needed to perform dialogue state tracking (DST). Our goal is to reduce the amount of natural language encoded at each turn, and the key parameter we investigate is the number of turns (H) to feed as history to model. We first explore the turning point where increasing H begins to yield limiting returns on the overall performance. Then we examine whether the examples a model with small H gets wrong can be categorized in a way for the model to do few shot finetuning on. Lastly, will explore the limitations of this approach, and whether there is a certain type of examples that this approach will not be able to resolve.


Superpotentials and Quiver Algebras for Semisimple Hopf Actions. We consider the action of a semisimple Hopf algebra H on an m Koszul Artin Schelter regular algebra A . Such an algebra A is a derivation quotient algebra for some twisted superpotential mathsf w , and we show that the homological determinant of the action of H on A can be easily calculated using mathsf w . Using this, we show that the smash product A , ,H is also a derivation quotient algebra, and use this to explicitly determine a quiver algebra Lambda to which A , ,H is Morita equivalent, generalising a result of Bocklandt Schedler Wemyss. We also show how Lambda can be used to determine whether the Auslander map is an isomorphism. We compute a number of examples, and show how several results for the quantum Kleinian singularities studied by Chan Kirkman Walton Zhang follow using our techniques.


Warming up recurrent neural networks to maximize reachable multi stability greatly improves learning. Training recurrent neural networks is known to be difficult when time dependencies become long. Consequently, training standard gated cells such as gated recurrent units and long short term memory on benchmarks where long term memory is required remains an arduous task. In this work, we propose a general way to initialize any recurrent network connectivity through a process called "warm up" to improve its capability to learn arbitrarily long time dependencies. This initialization process is designed to maximize network reachable multi stability, i.e. the number of attractors within the network that can be reached through relevant input trajectories. Warming up is performed before training, using stochastic gradient descent on a specifically designed loss. We show that warming up greatly improves recurrent neural network performance on long term memory benchmarks for multiple recurrent cell types, but can sometimes impede precision. We therefore introduce a parallel recurrent network structure with partial warm up that is shown to greatly improve learning on long time series while maintaining high levels of precision. This approach provides a general framework for improving learning abilities of any recurrent cell type when long term memory is required.


Chemistry Across Multiple Phases (CAMP) version 1.0 An integrated multi phase chemistry model. A flexible treatment for gas and aerosol phase chemical processes has been developed for models of diverse scale, from box models up to global models. At the core of this novel framework is an "abstracted aerosol representation" that allows a given chemical mechanism to be solved in atmospheric models with different aerosol representations (e.g., sectional, modal, or particle resolved). This is accomplished by treating aerosols as a collection of condensed phases that are implemented according to the aerosol representation of the host model. The framework also allows multiple chemical processes (e.g., gas and aerosol phase chemical reactions, emissions, deposition, photolysis, and mass transfer) to be solved simultaneously as a single system. The flexibility of the model is achieved by (1) using an object oriented design that facilitates extensibility to new types of chemical processes and to new ways of representing aerosol systems (2) runtime model configuration using JSON input files that permits making changes to any part of the chemical mechanism without recompiling the model this widely used, human readable format allows entire gas and aerosol phase chemical mechanisms to be described with as much complexity as necessary and (3) automated comprehensive testing that ensures stability of the code as new functionality is introduced. Together, these design choices enable users to build a customized multiphase mechanism, without having to handle pre processors, solvers or compilers. This new treatment compiles as a stand alone library and has been deployed in the particle resolved PartMC model and in the MONARCH chemical weather prediction system for use at regional and global scales. Results from the initial deployment will be discussed, along with future extension to more complex gas aerosol systems, and the integration of GPU based solvers.


CANDLE Decomposing Conditional and Conjunctive Queries for Task Oriented Dialogue Systems. Domain specific dialogue systems generally determine user intents by relying on sentence level classifiers which mainly focus on single action sentences. Such classifiers are not designed to effectively handle complex queries composed of conditional and sequential clauses that represent multiple actions. We attempt to decompose such queries into smaller single action sub queries that are reasonable for intent classifiers to understand in a dialogue pipeline. We release CANDLE (Conditional AND type Expressions), a dataset consisting of 3124 utterances manually tagged with conditional and sequential labels and demonstrates this decomposition by training two baseline taggers.


Criticality Experiments with Fast 25 and 49 Metal and Hydride Systems During the Manhattan Project. Criticality experiments with 235 U (metal and hydride) and 239 Pu (metal) were performed during the Manhattan Project. Results from these experiments provided necessary information for the success of the Manhattan Project. These experiments have been previously described in compilations made after the Manhattan Project, but those works are either lacking in technical details or are not publicly available. This work aims to provide detailed information while showcasing the enduring impact of these experiments 75 years after they were performed. Furthermore, we use modern computational methods embodied in the MCNP6 code and ENDF data to analyze and interpret these historic measurements. The world's first four criticality accidents are also discussed, as lessons learned from these helped shape the field of criticality experiments.


On the Laws of Thermodynamics in Classical Non Inertial Frames. This work consists in the theorical development on the analysis of the Thermodynamic Laws and thermodynamic systems in relative motion, according to the laws of Classical Mechanics. The difference of this work for many of the literature is the methodology used. We follow a strictly mathematical line, instead of a phenomenological line. We proved that the First and Second Laws of Thermodynamics in non inertial frames remain invariant under any spatial translation between reference frames in motion. From the results obtained, we show the transformation of the main thermodynamic quantities as temperature, pressure, chemical potential, internal energy, heat, state equation for an ideal gas and efficiency of Carnot's machine are also invariant under any transformation between non inertial reference frames.


Structured Prediction for CRiSP Inverse Kinematics Learning with Misspecified Robot Models. With the recent advances in machine learning, problems that traditionally would require accurate modeling to be solved analytically can now be successfully approached with data driven strategies. Among these, computing the inverse kinematics of a redundant robot arm poses a significant challenge due to the non linear structure of the robot, the hard joint constraints and the non invertible kinematics map. Moreover, most learning algorithms consider a completely data driven approach, while often useful information on the structure of the robot is available and should be positively exploited. In this work, we present a simple, yet effective, approach for learning the inverse kinematics. We introduce a structured prediction algorithm that combines a data driven strategy with the model provided by a forward kinematics function even when this function is misspecified to accurately solve the problem. The proposed approach ensures that predicted joint configurations are well within the robot's constraints. We also provide statistical guarantees on the generalization properties of our estimator as well as an empirical evaluation of its performance on trajectory reconstruction tasks.


Thermal Simulation and Experimental Analysis of Optically Pumped InP on Si Micro and Nanocavity Lasers. There is a general trend of downscaling laser cavities, but with high integration and energy densities of nanocavity lasers, signifi cant thermal issues affect their operation. The complexity of geometrical parameters and the various materials involved hinder the extraction of clear design guidelines and operation strategies. Here, we present a systematic thermal analysis of InP on Si micro and nanocavity lasers based on steady state and transient thermal simulations and experimental analysis. In particular, we investi gated the use of metal cavities for improving the thermal properties of InP on Si micro and nanocavity lasers. Heating of lasers is studied by using Raman thermometry and the results agree well with simulation results, both reveal a temperature reduction of hundreds of kelvins for the metal clad cavity. Transient simulations are carried out to improve our understanding of the dynamic temperature variation under pulsed and continuous wave pumping conditions. The results show that the presence of a metal clad ding not only increases the overall efficiency in heat dissipation, but also causes a much faster temperature response. Together with optical experimental results under pulsed pumping, we conclude that a pulse width of 10 ns and repetition rate of 100 kHz is the optimal pumping condition for a 2 micrometer wide square cavity.


The Single Noun Prior for Image Clustering. Self supervised clustering methods have achieved increasing accuracy in recent years but do not yet perform as well as supervised classification methods. This contrasts with the situation for feature learning, where self supervised features have recently surpassed the performance of supervised features on several important tasks. We hypothesize that the performance gap is due to the difficulty of specifying, without supervision, which features correspond to class differences that are semantic to humans. To reduce the performance gap, we introduce the "single noun" prior which states that semantic clusters tend to correspond to concepts that humans label by a single noun. By utilizing a pre trained network that maps images and sentences into a common space, we impose this prior obtaining a constrained optimization task. We show that our formulation is a special case of the facility location problem, and introduce a simple yet effective approach for solving this optimization task at scale. We test our approach on several commonly reported image clustering datasets and obtain significant accuracy gains over the best existing approaches.


Transverse mode selective laser with gain regulation by a digital micromirror device. A transverse mode selective laser system with gain regulation by a digital micromirror device (DMD) is presented in this letter. The gain regulation in laser medium is adjusted by the switch of the patterns loaded on DMD. Structured pump beam patterns can be obtained after the reflection of the loaded patterns on DMD, and then it's defocused into a microchip laser medium by a short focal lens, so that the pump patterns can be transferred to the gain medium to regulate the gain distribution. Corresponding structured laser beams can be generated by this laser system. The laser beam pattern can be regulated easily and quickly, by switching the loaded patterns on DMD. Through this method, we show a simple and flexible laser system to generate on demand laser beam patterns.


Supporting AI Engineering on the IoT Edge through Model Driven TinyML. Software engineering of network centric Artificial Intelligence (AI) and Internet of Things (IoT) enabled Cyber Physical Systems (CPS) and services, involves complex design and validation challenges. In this paper, we propose a novel approach, based on the model driven software engineering paradigm, in particular the domain specific modeling methodology. We focus on a sub discipline of AI, namely Machine Learning (ML) and propose the delegation of data analytics and ML to the IoT edge. This way, we may increase the service quality of ML, for example, its availability and performance, regardless of the network conditions, as well as maintaining the privacy, security and sustainability. We let practitioners assign ML tasks to heterogeneous edge devices, including highly resource constrained embedded microcontrollers with main memories in the order of Kilobytes, and energy consumption in the order of milliwatts. This is known as TinyML. Furthermore, we show how software models with different levels of abstraction, namely platform independent and platform specific models can be used in the software development process. Finally, we validate the proposed approach using a case study addressing the predictive maintenance of a hydraulics system with various networked sensors and actuators.


On Brightness Agnostic Adversarial Examples Against Face Recognition Systems. This paper introduces a novel adversarial example generation method against face recognition systems (FRSs). An adversarial example (AX) is an image with deliberately crafted noise to cause incorrect predictions by a target system. The AXs generated from our method remain robust under real world brightness changes. Our method performs non linear brightness transformations while leveraging the concept of curriculum learning during the attack generation procedure. We demonstrate that our method outperforms conventional techniques from comprehensive experimental investigations in the digital and physical world. Furthermore, this method enables practical risk assessment of FRSs against brightness agnostic AXs.


Energy preserving multiphase flows Application to falling films. The numerical simulation of multiphase flows presents several challenges, namely the transport of different phases within de domain and the inclusion of capillary effects. Here, these are approached by enforcing a discrete physics compatible solution. Extending our previous work on the discretization of surface tension N. Valle, F. X. Trias, and J. Castro. An energy preserving level set method for multiphase flows. J. Comput. Phys., 400 108991, 2020 with a consistent mass and momentum transfer a fully energy preserving multiphase flow method is presented. This numerical technique is showcased within the simulation of a falling film under several working conditions related to the normal operation of LiBr absorption chillers.


Physics informed neural network method for modelling beam wall interactions. A mesh free approach for modelling beam wall interactions in particle accelerators is proposed. The key idea of our method is to use a deep neural network as a surrogate for the solution to a set of partial differential equations involving the particle beam, and the surface impedance concept. The proposed approach is applied to the coupling impedance of an accelerator vacuum chamber with thin conductive coating, and also verified in comparison with the existing analytical formula.


What is the Vocabulary of Flaky Tests? An Extended Replication. Software systems have been continuously evolved and delivered with high quality due to the widespread adoption of automated tests. A recurring issue hurting this scenario is the presence of flaky tests, a test case that may pass or fail non deterministically. A promising, but yet lacking more empirical evidence, approach is to collect static data of automated tests and use them to predict their flakiness. In this paper, we conducted an empirical study to assess the use of code identifiers to predict test flakiness. To do so, we first replicate most parts of the previous study of Pinto et al. (MSR 2020). This replication was extended by using a different ML Python platform (Scikit learn) and adding different learning algorithms in the analyses. Then, we validated the performance of trained models using datasets with other flaky tests and from different projects. We successfully replicated the results of Pinto et al. (2020), with minor differences using Scikit learn different algorithms had performance similar to the ones used previously. Concerning the validation, we noticed that the recall of the trained models was smaller, and classifiers presented a varying range of decreases. This was observed in both intra project and inter projects test flakiness prediction.


Quantum Information and the Mind Body Problem. The mind body problem is reviewed in the context of a non technical account of quantum information theory. The importance of clearly defining what is physical?' is highlighted, since only then can we give meaning to the concept non physical'. Physicality is defined in terms of interaction, which is in turn defined to be a correlated exchange of information. This is asserted to be the basis of any meaningful concept of epistemology. Hence, it is argued that a non physical entity can not know' anything about the world. Information transfer is then discussed in terms of quantum entanglement and an argument for our perception of time is presented. It is then contended that the notion of mind' may be meaningfully discussed in the context of a quantum theoretic framework.


Divisibility conditions on the order of the reductions of algebraic numbers. Let K be a number field, and let G be a finitely generated subgroup of K times . Without relying on (GRH) we prove an asymptotic formula for the number of primes mathfrak p of K such that the order of (G bmod mathfrak p) is divisible by a fixed integer. We also provide a rational expression for the natural density of this set. Furthermore, we study the primes mathfrak p for which the order is k free, and those for which the order has a prescribed ell adic valuation for finitely many primes ell . An additional condition on the Frobenius conjugacy class of mathfrak p may be considered. In order to establish these results, we prove an unconditional version of the Chebotarev density theorem for Kummer extensions of number fields.


Constelaciones mayas Visualizaci 'on e interpretaci 'on utilizando herramientas inform 'aticas. There has been a long standing debate about the existence of maya constellations, but there are several sources of evidences that favour this hypothesis mural paintings, stelae and codex. In this work, we have recovered and compiled information regarding mayan constellations and the mayan names for selected celestial bodies. We explain the process that was carried out to obtain all the information available and compile it under the same digital support. The result was incorporated into the Stellarium astronomical software to enrich the modules of archaeoastronomy and stellar legend, where constellations from diverse cultures are made available to users of the software by simulating their appearance in the night sky.