ALEBk Feasibility Study of Attention Level Estimation via Blink Detection applied to e Learning. This work presents a feasibility study of remote attention level estimation based on eye blink frequency. We first propose an eye blink detection system based on Convolutional Neural Networks (CNNs), very competitive with respect to related works. Using this detector, we experimentally evaluate the relationship between the eye blink rate and the attention level of students captured during online sessions. The experimental framework is carried out using a public multimodal database for eye blink detection and attention level estimation called mEBAL, which comprises data from 38 students and multiples acquisition sensors, in particular, i) an electroencephalogram (EEG) band which provides the time signals coming from the student's cognitive information, and ii) RGB and NIR cameras to capture the students face gestures. The results achieved suggest an inverse correlation between the eye blink frequency and the attention level. This relation is used in our proposed method called ALEBk for estimating the attention level as the inverse of the eye blink frequency. Our results open a new research line to introduce this technology for attention level estimation on future e learning platforms, among other applications of this kind of behavioral biometrics based on face analysis.


Regularization Graphs A unified framework for variational regularization of inverse problems. We introduce and study a mathematical framework for a broad class of regularization functionals for ill posed inverse problems Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear operators and convex functionals, assembled by means of operators that can be seen as generalizations of classical infimal convolution operators. This class of functionals exhaustively covers existing regularization approaches and it is flexible enough to craft new ones in a simple and constructive way. We provide well posedness and convergence results with the proposed class of functionals in a general setting. Further, we consider a bilevel optimization approach to learn optimal weights for such regularization graphs from training data. We demonstrate that this approach is capable of optimizing the structure and the complexity of a regularization graph, allowing, for example, to automatically select a combination of regularizers that is optimal for given training data.


Calibration of Human Driving Behavior and Preference Using Naturalistic Traffic Data. Understanding human driving behaviors quantitatively is critical even in the era when connected and autonomous vehicles and smart infrastructure are becoming ever more prevalent. This is particularly so as that mixed traffic settings, where autonomous vehicles and human driven vehicles co exist, are expected to persist for quite some time. Towards this end it is necessary that we have a comprehensive modeling framework for decision making within which human driving preferences can be inferred statistically from observed driving behaviors in realistic and naturalistic traffic settings. Leveraging a recently proposed computational framework for smart vehicles in a smart world using multi agent based simulation and optimization, we first recapitulate how the forward problem of driving decision making is modeled as a state space model. We then show how the model can be inverted to estimate driver preferences from naturalistic traffic data using the standard Kalman filter technique. We explicitly illustrate our approach using the vehicle trajectory data from Sugiyama experiment that was originally meant to demonstrate how stop and go shockwave can arise spontaneously without bottlenecks. Not only the estimated state filter can fit the observed data well for each individual vehicle, the inferred utility functions can also re produce quantitatively similar pattern of the observed collective behaviors. One distinct advantage of our approach is the drastically reduced computational burden. This is possible because our forward model treats driving decision process, which is intrinsically dynamic with multi agent interactions, as a sequence of independent static optimization problems contingent on the state with a finite look ahead anticipation. Consequently we can practically sidestep solving an interacting dynamic inversion problem that would have been much more computationally demanding.


A Regular Gonosomal Evolution Operator with uncountable set of fixed points. In this paper we study dynamical systems generated by a gonosomal evolution operator of a bisexual population. We find explicitly all (uncountable set) of fixed points of the operator. It is shown that each fixed point has eigenvalues less or equal to 1. Moreover, we show that each trajectory converges to a fixed point, i.e. the operator is reqular. There are uncountable family of invariant sets each of which consisting unique fixed point. Thus there is one to one correspondence between such invariant sets and the set of fixed points. Any trajectory started at a point of the invariant set converges to the corresponding fixed point.


OSSR PID One Shot Symbol Recognition in P ID Sheets using Path Sampling and GCN. Piping and Instrumentation Diagrams (P ID) are ubiquitous in several manufacturing, oil and gas enterprises for representing engineering schematics and equipment layout. There is an urgent need to extract and digitize information from P IDs without the cost of annotating a varying set of symbols for each new use case. A robust one shot learning approach for symbol recognition i.e., localization followed by classification, would therefore go a long way towards this goal. Our method works by sampling pixels sequentially along the different contour boundaries in the image. These sampled points form paths which are used in the prototypical line diagram to construct a graph that captures the structure of the contours. Subsequently, the prototypical graphs are fed into a Dynamic Graph Convolutional Neural Network (DGCNN) which is trained to classify graphs into one of the given symbol classes. Further, we append embeddings from a Resnet 34 network which is trained on symbol images containing sampled points to make the classification network more robust. Since, many symbols in P ID are structurally very similar to each other, we utilize Arcface loss during DGCNN training which helps in maximizing symbol class separability by producing highly discriminative embeddings. The images consist of components attached on the pipeline (straight line). The sampled points segregated around the symbol regions are used for the classification task. The proposed pipeline, named OSSR PID, is fast and gives outstanding performance for recognition of symbols on a synthetic dataset of 100 P ID diagrams. We also compare our method against prior work on a real world private dataset of 12 P ID sheets and obtain comparable superior results. Remarkably, it is able to achieve such excellent performance using only one prototypical example per symbol.


Federated Learning with Fair Averaging. Fairness has emerged as a critical problem in federated learning (FL). In this work, we identify a cause of unfairness in FL conflicting gradients with large differences in the magnitudes. To address this issue, we propose the federated fair averaging (FedFV) algorithm to mitigate potential conflicts among clients before averaging their gradients. We first use the cosine similarity to detect gradient conflicts, and then iteratively eliminate such conflicts by modifying both the direction and the magnitude of the gradients. We further show the theoretical foundation of FedFV to mitigate the issue conflicting gradients and converge to Pareto stationary solutions. Extensive experiments on a suite of federated datasets confirm that FedFV compares favorably against state of the art methods in terms of fairness, accuracy and efficiency. The source code is available at https github.com WwZzz easyFL.


math.NA cs.NA physics.comp-ph physics.optics

PML and high accuracy boundary integral equation solver for wave scattering by a locally defected periodic surface. This paper studies the PML method for wave scattering in a half space of homogeneous medium bounded by a two dimensional, perfectly conducting, and locally defected periodic surface, and develops a high accuracy boundary integral equation (BIE) solver. Along the vertical direction, we place a PML to truncate the unbounded domain onto a strip and prove that the PML solution converges linearly to the true solution in the physical subregion of the strip with the PML thickness. Laterally, we divide the unbounded strip into three regions a region containing the defect and two semi waveguide regions, separated by two vertical line segments. In both semi waveguides, we prove the well posedness of an associated scattering problem so as to well define a Neumann to Dirichlet (NtD) operator on the associated vertical segment. The two NtD operators, serving as exact lateral boundary conditions, reformulate the unbounded strip problem as a boundary value problem onto the defected region. Due to the periodicity of the semi waveguides, both NtD operators turn out to be closely related to a Neumann marching operator, governed by a nonlinear Riccati equation. It is proved that the Neumann marching operators are contracting, so that the PML solution decays exponentially fast along both lateral directions. The consequences culminate in two opposite aspects. Negatively, the PML solution cannot exponentially converge to the true solution in the whole physical region of the strip. Positively, from a numerical perspective, the Riccati equations can now be efficiently solved by a recursive doubling procedure and a high accuracy PML based BIE method so that the boundary value problem on the defected region can be solved efficiently and accurately. Numerical experiments demonstrate that the PML solution converges exponentially fast to the true solution in any compact subdomain of the strip.


Discrete adjoint computations for relaxation Runge Kutta methods. Relaxation Runge Kutta methods reproduce a fully discrete dissipation (or conservation) of entropy for entropy stable semi discretizations of nonlinear conservation laws. In this paper, we derive the discrete adjoint of relaxation Runge Kutta schemes, which are applicable to discretize then optimize approaches for optimal control problems. Furthermore, we prove that the derived discrete relaxation Runge Kutta adjoint preserves time symmetry when applied to linear skew symmetric systems of ODEs. Numerical experiments verify these theoretical results while demonstrating the importance of appropriately treating the relaxation parameter when computing the discrete adjoint.


Hybrid Beam Alignment for Multi Path Channels A Group Testing Viewpoint. Directional beams are key to enabling wireless communications at high frequency bands such as millimeter wave and terahertz. Beam alignment (BA) methods allow the transceivers to adjust the directions of these beams in an efficient manner by exploiting the channel sparsity at high frequencies. This paper considers an uplink scenario consisting of a user equipment (UE) and a base station (BS), where the channel between the UE and BS consists of multiple paths. The BS wishes to localize the angle of arrival of each of these paths with a given resolution. At each time slot of the BA, the UE transmits a BA packet and the BS uses hybrid beamforming to scan its angular region. In order to minimize the expected BA duration, a group testing framework is devised, and the associated novel analog and hybrid BA strategies are described. Simulation studies suggest that the proposed schemes outperform the state of the art multi path BA methods.


Aerodynamic effects and performance improvements of running in drafting formations. Drafting as a process to reduce drag and to benefit from the presence of other competitors is applied in various sports with several recent examples of competitive running in formations. In this study, the aerodynamics of a realistic model of a female runner is calculated by computational fluid dynamics (CFD) simulations at four running speeds of 15 km h, 18 km h, 21 km h, and 36 km h. Aerodynamic power fractions of the total energy expenditure are found to be in the range of 2.6 8.5 . Additionally, four exemplary formations are analysed with respect to their drafting potential and resulting drag values are compared for the main runner and her pacers. The best of the formations achieves a total drag reduction on the main runner of 75.6 . Moreover, there are large variations in the drag reduction between the considered formations of up to 42 with respect to the baseline single runner case. We conclude that major drag reduction of more than 70 can already be achieved with fairly simple formations, while certain factors, such as runners on the sides, can have a detrimental effect on drag reduction due to local acceleration of the passing flow. Using an empirical model for mechanical power output during running, gains of metabolic power and performance predictions are evaluated for all considered formations. Improvements in running economy are up to 3.5 for the best formation, leading to velocity gains of 2.3 . This translates to 154 s ( 2.6 min) saved over a marathon distance. Consequently, direct conclusions are drawn from the obtained data for ideal drafting of long distance running in highly packed formations.


GPT 3 Models are Poor Few Shot Learners in the Biomedical Domain. Deep neural language models have set new breakthroughs in many tasks of Natural Language Processing (NLP). Recent work has shown that deep transformer language models (pretrained on large amounts of texts) can achieve high levels of task specific few shot performance comparable to state of the art models. However, the ability of these large language models in few shot transfer learning has not yet been explored in the biomedical domain. We investigated the performance of two powerful transformer language models, i.e. GPT 3 and BioBERT, in few shot settings on various biomedical NLP tasks. The experimental results showed that, to a great extent, both the models underperform a language model fine tuned on the full training data. Although GPT 3 had already achieved near state of the art results in few shot knowledge transfer on open domain NLP tasks, it could not perform as effectively as BioBERT, which is orders of magnitude smaller than GPT 3. Regarding that BioBERT was already pretrained on large biomedical text corpora, our study suggests that language models may largely benefit from in domain pretraining in task specific few shot learning. However, in domain pretraining seems not to be sufficient novel pretraining and few shot learning strategies are required in the biomedical NLP domain.


Stable numerical evaluation of multi degree B splines. Multi degree splines are piecewise polynomial functions having sections of different degrees. They offer significant advantages over the classical uniform degree framework, as they allow for modeling complex geometries with fewer degrees of freedom and, at the same time, for a more efficient engineering analysis. Moreover they possess a set of basis functions with similar properties to standard B splines. In this paper we develop an algorithm for efficient evaluation of multi degree B splines, which, unlike previous approaches, is numerically stable. The proposed method consists in explicitly constructing a mapping between a known basis and the multi degree B spline basis of the space of interest, exploiting the fact that the two bases are related by a sequence of knot insertion and or degree elevation steps and performing only numerically stable operations. In addition to theoretically justifying the stability of the algorithm, we will illustrate its performance through numerical experiments that will serve us to demonstrate its excellent behavior in comparison with existing methods, which, in some cases, suffer from apparent numerical problems.


Cerium (III) and (IV) containing mesoporous glasses alginate beads for bone regeneration bioactivity, biocompatibility and reactive oxygen species activity. A very small number of biomaterials investigated for bone regeneration was reported as able to prevent the oxidative stress. In this study beads based on alginate hydrogel and mesoporous glasses (MG) containing different amounts of cerium oxides (Ce3 Ce4 ) exhibiting antioxidant properties were investigated as a good approach to mimic the action of antioxidant enzymes in our organism. The effect of cerium contents on the bioactivity and biocompatibility of beads were investigated. Moreover, the potential capability of Ce containing MG to prevent the oxidative stress caused by the activity of reactive oxygen species (ROS) was here investigated for the first time. The increment of cerium oxide from 1.2, to 3.6 and 5.3 mol decreases the surface area and porosity of MG and increases the catalase mimetic activity after 168 h. Swelling tests in different cell culture media (D and alpha MEM) demonstrated the rehydration capability of beads. The presence of beads with the highest Ce contents (3.6 and 5.3 ) improved the proliferation of pre osteoblastic cells MC3T3 C1 cells. However, the cell differentiation decreased when increased the cerium content. Lactate dehydrogenase assays showed beads are cytocompatible materials. Moreover, oxidative stress tests with H2O2 showed a better response related to cell viability and the elimination of oxidant species when increased cerium content. Beads of glasses with 1.2 and 3.6 of CeO2 are excellent candidates as bioactive scaffolds for bone regeneration capable of counteract the oxidative stress.


Safety Critical Learning of Robot Control with Temporal Logic Specifications. Reinforcement learning (RL) is a promising approach. However, success is limited towards real world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with unknown models and measurement uncertainties. The learning problem becomes even more difficult for complex tasks over continuous state space and action space. In this paper, we propose a learning based robotic control framework consisting of several aspects (1) we leverage Linear Temporal Logic (LTL) to express complex tasks over an infinite horizons that are translated to a novel automaton structure (2) we detail an innovative reward scheme for LTL satisfaction with probabilistic guarantee. Then, by applying a reward shaping technique, we develop a modular policy gradient architecture exploiting the benefits of the automaton structure to decompose overall tasks and enhance the performance of learned controllers (3) by incorporating Gaussian Processes (GPs) to estimate the uncertain dynamic systems, we synthesize a model based safe exploration during learning process using Exponential Control Barrier Functions (ECBFs) for systems with high order relative degrees. (4) to further improve the efficiency of exploration, we utilize the properties of LTL automata and ECBFs to propose a safe guiding process. Finally, we demonstrate the effectiveness of the framework via several robotic environments. We show an ECBF based modular deep RL algorithm that achieves near perfect success rates and safety guarding with high probability confidence during training.


Arbitrary Virtual Try On Network Characteristics Preservation and Trade off between Body and Clothing. Deep learning based virtual try on system has achieved some encouraging progress recently, but there still remain several big challenges that need to be solved, such as trying on arbitrary clothes of all types, trying on the clothes from one category to another and generating image realistic results with few artifacts. To handle this issue, we in this paper first collect a new dataset with all types of clothes, ie tops, bottoms, and whole clothes, each one has multiple categories with rich information of clothing characteristics such as patterns, logos, and other details. Based on this dataset, we then propose the Arbitrary Virtual Try On Network (AVTON) that is utilized for all type clothes, which can synthesize realistic try on images by preserving and trading off characteristics of the target clothes and the reference person. Our approach includes three modules 1) Limbs Prediction Module, which is utilized for predicting the human body parts by preserving the characteristics of the reference person. This is especially good for handling cross category try on task ( eg long sleeves ( leftrightarrow ) short sleeves or long pants ( leftrightarrow ) skirts, etc), where the exposed arms or legs with the skin colors and details can be reasonably predicted 2) Improved Geometric Matching Module, which is designed to warp clothes according to the geometry of the target person. We improve the TPS based warping method with a compactly supported radial function (Wendland's ( Psi ) function) 3) Trade Off Fusion Module, which is to trade off the characteristics of the warped clothes and the reference person. This module is to make the generated try on images look more natural and realistic based on a fine tune symmetry of the network structure. Extensive simulations are conducted and our approach can achieve better performance compared with the state of the art virtual try on methods.


Design of hazard based model and collision avoidance system. The primary goal of this paper is to examine the motorcyclists' activities during the overtaking period, as well as to develop a model of total overtaking time. For the experimental study, instrumented motorcycles were used to collect data and design an overall overtaking period model. The possibility of death during an attempt to overtake is maximum for people walking on rural roads, mainly identified by a scarcity of pathways and higher speeds of vehicles. It is important to recognize and prototype driver actions during the overtaking moves to set up collision avoidance strategies in order to prevent these collisions, such that device adjustments are acceptable as they occur beyond the comfort zone of the drivers. The purpose of this research is to address both vehicle overtaking movements along urban roads and to develop a collision avoidance system. This research, based on tests performed and instrumented driving information, may lead to the discovery of advanced driver assistance systems, analyzing driver behavior during overtaking. A total of 500 overtaking movements were registered with 50 motorcycles set up with a high resolution camera and GPS system implemented by 50 professional bikers in India in an undivided one way road. A technique was developed to collect data explaining the actions of the motorcyclists, based on video and GPS analyses. The overall overtaking period was designed using a risk based model, which indicates the span of the overtaking based on several coefficients. The proposed model is useful to analyze the behavior during overtaking moves, as well as to develop road and vehicle safety systems to reduce the chances of accidents.


Designing a Plasma Lens as a Matching Device for the ILC Positron Source. To realise a planned high luminosity and high energy e e collider, as the ILC, a large amount of positrons have to be produced and the accelerated particles have to be captured and matched according to the damping ring acceptances. There exist several technical possibilities. In this contribution a new promising alternative method for capturing positrons will be presented, the application of the plasma lens as an optical matching device. It will be compared with the current matching device proposed for the ILC, namely the quarter wave transformer. An advantage of the plasma lens is the different magnetic field component, which focuses the divergent beam in a more effective manner. Therefore it will be shown in this paper that the yield requirements could be achieved more easily. The plasma lens can actually be a promising alternative for focusing beams as soon as the technical feasibility has been approved. In the simulation, a tapered active plasma lens has been optimized using the approximation of a homogeneous electric current density constant in time. The optimization process led to a plasma lens design that improves on the ILC's currently proposed optical matching device, namely the quarter wave transformer, by approximately 50 100 . Furthermore the design has been shown to guarantee a stable captured positron yield within pm1.5 for single, independent parameter deviations of about pm10 .


Hamilton circuits of Cayley graphs of Weyl groupoids of generalized quantum groups. We study Hamilton circuits of the Cayley graphs of the Weyl groupoids of the generalized quantum groups, or the quantum double of the Nichols algebras of diagonal type, with finite root systems. We prove the existence of a Hamilton circuit for any of them and explicitly draw one of them for rank 3 and 4 cases.


Accuracy and Privacy Evaluations of Collaborative Data Analysis. Distributed data analysis without revealing the individual data has recently attracted significant attention in several applications. A collaborative data analysis through sharing dimensionality reduced representations of data has been proposed as a non model sharing type federated learning. This paper analyzes the accuracy and privacy evaluations of this novel framework. In the accuracy analysis, we provided sufficient conditions for the equivalence of the collaborative data analysis and the centralized analysis with dimensionality reduction. In the privacy analysis, we proved that collaborative users' private datasets are protected with a double privacy layer against insider and external attacking scenarios.


Revizor Testing Black box CPUs against Speculation Contracts. Speculative vulnerabilities such as Spectre and Meltdown expose speculative execution state that can be exploited to leak information across security domains via side channels. Such vulnerabilities often stay undetected for a long time as we lack the tools for systematic testing of CPUs to find them. In this paper, we propose an approach to automatically detect microarchitectural information leakage in commercial black box CPUs. We build on speculation contracts, which we employ to specify the permitted side effects of program execution on the CPU's microarchitectural state. We propose a Model based Relational Testing (MRT) technique to empirically assess the CPU compliance with these specifications. We implement MRT in a testing framework called Revizor, and showcase its effectiveness on real Intel x86 CPUs. Revizor automatically detects violations of a rich set of contracts, or indicates their absence. A highlight of our findings is that Revizor managed to automatically surface Spectre, MDS, and LVI, as well as several previously unknown variants.


Bayesian deep learning of affordances from RGB images. Autonomous agents, such as robots or intelligent devices, need to understand how to interact with objects and its environment. Affordances are defined as the relationships between an agent, the objects, and the possible future actions in the environment. In this paper, we present a Bayesian deep learning method to predict the affordances available in the environment directly from RGB images. Based on previous work on socially accepted affordances, our model is based on a multiscale CNN that combines local and global information from the object and the full image. However, previous works assume a deterministic model, but uncertainty quantification is fundamental for robust detection, affordance based reason, continual learning, etc. Our Bayesian model is able to capture both the aleatoric uncertainty from the scene and the epistemic uncertainty associated with the model and previous learning process. For comparison, we estimate the uncertainty using two state of the art techniques Monte Carlo dropout and deep ensembles. We also compare different types of CNN encoders for feature extraction. We have performed several experiments on an affordance database on socially acceptable behaviours and we have shown improved performance compared with previous works. Furthermore, the uncertainty estimation is consistent with the the type of objects and scenarios. Our results show a marginal better performance of deep ensembles, compared to MC dropout on the Brier score and the Expected Calibration Error.


A non existence result for the L p Minkowski problem. We show that given a real number p 1 , a positive integer n and a proper subspace H of mathbb R n , the measure on the Euclidean sphere mathbb S n 1 , which is concentrated in H and whose restriction to the class of Borel subsets of mathbb S n 1 cap H equals the spherical Lebesgue measure on mathbb S n 1 cap H , is not the L p surface area measure of any convex body. This, in particular, disproves a conjecture from Bianchi, B "or "oczky, Colesanti, Yang, The L p Minkowski problem for n p 1 , Adv. Math. (2019) .


Sparse DETR Efficient End to End Object Detection with Learnable Sparsity. DETR is the first end to end object detector using a transformer encoder decoder architecture and demonstrates competitive performance but low computational efficiency on high resolution feature maps. The subsequent work, Deformable DETR, enhances the efficiency of DETR by replacing dense attention with deformable attention, which achieves 10x faster convergence and improved performance. Deformable DETR uses the multiscale feature to ameliorate performance, however, the number of encoder tokens increases by 20x compared to DETR, and the computation cost of the encoder attention remains a bottleneck. In our preliminary experiment, we observe that the detection performance hardly deteriorates even if only a part of the encoder token is updated. Inspired by this observation, we propose Sparse DETR that selectively updates only the tokens expected to be referenced by the decoder, thus help the model effectively detect objects. In addition, we show that applying an auxiliary detection loss on the selected tokens in the encoder improves the performance while minimizing computational overhead. We validate that Sparse DETR achieves better performance than Deformable DETR even with only 10 encoder tokens on the COCO dataset. Albeit only the encoder tokens are sparsified, the total computation cost decreases by 38 and the frames per second (FPS) increases by 42 compared to Deformable DETR. Code is available at https github.com kakaobrain sparse detr


Frequency Centric Defense Mechanisms against Adversarial Examples. Adversarial example (AE) aims at fooling a Convolution Neural Network by introducing small perturbations in the input image.The proposed work uses the magnitude and phase of the Fourier Spectrum and the entropy of the image to defend against AE. We demonstrate the defense in two ways by training an adversarial detector and denoising the adversarial effect. Experiments were conducted on the low resolution CIFAR 10 and high resolution ImageNet datasets. The adversarial detector has 99 accuracy for FGSM and PGD attacks on the CIFAR 10 dataset. However, the detection accuracy falls to 50 for sophisticated DeepFool and Carlini Wagner attacks on ImageNet. We overcome the limitation by using autoencoder and show that 70 of AEs are correctly classified after denoising.


VANiLLa Verbalized Answers in Natural Language at Large Scale. In the last years, there have been significant developments in the area of Question Answering over Knowledge Graphs (KGQA). Despite all the notable advancements, current KGQA datasets only provide the answers as the direct output result of the formal query, rather than full sentences incorporating question context. For achieving coherent answers sentence with the question's vocabulary, template based verbalization so are usually employed for a better representation of answers, which in turn require extensive expert intervention. Thus, making way for machine learning approaches however, there is a scarcity of datasets that empower machine learning models in this area. Hence, we provide the VANiLLa dataset which aims at reducing this gap by offering answers in natural language sentences. The answer sentences in this dataset are syntactically and semantically closer to the question than to the triple fact. Our dataset consists of over 100k simple questions adapted from the CSQA and SimpleQuestionsWikidata datasets and generated using a semi automatic framework. We also present results of training our dataset on multiple baseline models adapted from current state of the art Natural Language Generation (NLG) architectures. We believe that this dataset will allow researchers to focus on finding suitable methodologies and architectures for answer verbalization.


Normalizers and centralizers of p subgroups in normal subsystems of fusion systems. Suppose mathcal E is a normal subsystem of a saturated fusion system mathcal F over S . If X leq S is fully mathcal F normalized, then Aschbacher defined a normal subsystem N mathcal E (X) of N mathcal F (X) . In this short note we revisit and generalize this result using the theory of localities. Our more general approach leads in particular to a normal subsystem C mathcal E (X) of C mathcal F (X) for every X leq S which is fully mathcal F centralized.


On volumes of hyperbolic right angled polyhedra. In this paper we obtain new upper bounds on volumes of right angled polyhedra in hyperbolic space mathbb H 3 in three different cases for ideal polyhedra with all vertices on the ideal hyperbolic boundary, for compact polytopes with only finite (or usual) vertices, and for finite volume polyhedra with vertices of both types.


Towards Balanced Learning for Instance Recognition. Instance recognition is rapidly advanced along with the developments of various deep convolutional neural networks. Compared to the architectures of networks, the training process, which is also crucial to the success of detectors, has received relatively less attention. In this work, we carefully revisit the standard training practice of detectors, and find that the detection performance is often limited by the imbalance during the training process, which generally consists in three levels sample level, feature level, and objective level. To mitigate the adverse effects caused thereby, we propose Libra R CNN, a simple yet effective framework towards balanced learning for instance recognition. It integrates IoU balanced sampling, balanced feature pyramid, and objective re weighting, respectively for reducing the imbalance at sample, feature, and objective level. Extensive experiments conducted on MS COCO, LVIS and Pascal VOC datasets prove the effectiveness of the overall balanced design.


An Extended Epidemic Model on Interconnected Networks for COVID 19 to Explore the Epidemic Dynamics. COVID 19 has resulted in a public health global crisis. The pandemic control necessitates epidemic models that capture the trends and impacts on infectious individuals. Many exciting models can implement this but they lack practical interpretability. This study combines the epidemiological and network theories and proposes a framework with causal interpretability in response to this issue. This framework consists of an extended epidemic model in interconnected networks and a dynamic structure that has major human mobility. The networked causal analysis focuses on the stochastic processing mechanism. It highlights the social infectivity as the intervention estimator between the observable effect (the number of daily new cases) and unobservable causes (the number of infectious persons). According to an experiment on the dataset for Tokyo metropolitan areas, the computational results indicate the propagation features of the symptomatic and asymptomatic infectious persons. These new spatiotemporal findings can be beneficial for policy decision making.


On the Inherent Regularization Effects of Noise Injection During Training. Randomly perturbing networks during the training process is a commonly used approach to improving generalization performance. In this paper, we present a theoretical study of one particular way of random perturbation, which corresponds to injecting artificial noise to the training data. We provide a precise asymptotic characterization of the training and generalization errors of such randomly perturbed learning problems on a random feature model. Our analysis shows that Gaussian noise injection in the training process is equivalent to introducing a weighted ridge regularization, when the number of noise injections tends to infinity. The explicit form of the regularization is also given. Numerical results corroborate our asymptotic predictions, showing that they are accurate even in moderate problem dimensions. Our theoretical predictions are based on a new correlated Gaussian equivalence conjecture that generalizes recent results in the study of random feature models.


Real Time Visual Analysis of High Volume Social Media Posts. Breaking news and first hand reports often trend on social media platforms before traditional news outlets cover them. The real time analysis of posts on such platforms can reveal valuable and timely insights for journalists, politicians, business analysts, and first responders, but the high number and diversity of new posts pose a challenge. In this work, we present an interactive system that enables the visual analysis of streaming social media data on a large scale in real time. We propose an efficient and explainable dynamic clustering algorithm that powers a continuously updated visualization of the current thematic landscape as well as detailed visual summaries of specific topics of interest. Our parallel clustering strategy provides an adaptive stream with a digestible but diverse selection of recent posts related to relevant topics. We also integrate familiar visual metaphors that are highly interlinked for enabling both explorative and more focused monitoring tasks. Analysts can gradually increase the resolution to dive deeper into particular topics. In contrast to previous work, our system also works with non geolocated posts and avoids extensive preprocessing such as detecting events. We evaluated our dynamic clustering algorithm and discuss several use cases that show the utility of our system.


SPBERT An Efficient Pre training BERT on SPARQL Queries for Question Answering over Knowledge Graphs. In this paper, we propose SPBERT, a transformer based language model pre trained on massive SPARQL query logs. By incorporating masked language modeling objectives and the word structural objective, SPBERT can learn general purpose representations in both natural language and SPARQL query language. We investigate how SPBERT and encoder decoder architecture can be adapted for Knowledge based QA corpora. We conduct exhaustive experiments on two additional tasks, including SPARQL Query Construction and Answer Verbalization Generation. The experimental results show that SPBERT can obtain promising results, achieving state of the art BLEU scores on several of these tasks.


Higher order topological phases in tunable C 3 symmetric photonic crystals. We demonstrate that multiple higher order topological transitions can be triggered via the continuous change of the geometry in kagome photonic crystals composed of three dielectric rods. By tuning a single geometry parameter, the photonic corner and edge states emerge or disappear with the higher order topological transitions. Two distinct higher order topological insulator phases and a normal insulator phase are revealed. Their topological indices are obtained from symmetry representations. A photonic analog of fractional corner charge is introduced to distinguish the two higher order topological insulator phases. Our predictions can be readily realized and verified in configurable dielectric photonic crystals.


Alon Seymour Thomas Revisited. Alon, Seymour and Thomas 1990 proved that every K t minor free graph has a balanced separator of size at most t 3 2 n 1 2 vertices. In fact, they proved a stronger result in terms of havens'. By the duality of havens and treewidth they concluded that every K t minor free graph on n vertices has treewidth less than t 3 2 n 1 2 . This note reproves the latter result without using havens or any form of treewidth duality. Instead, the proof directly constructs a tree decomposition of G with width less than t 3 2 n 1 2 .


Searching to Sparsify Tensor Decomposition for N ary Relational Data. Tensor, an extension of the vector and matrix to the multi dimensional case, is a natural way to describe the N ary relational data. Recently, tensor decomposition methods have been introduced into N ary relational data and become state of the art on embedding learning. However, the performance of existing tensor decomposition methods is not as good as desired. First, they suffer from the data sparsity issue since they can only learn from the N ary relational data with a specific arity, i.e., parts of common N ary relational data. Besides, they are neither effective nor efficient enough to be trained due to the over parameterization problem. In this paper, we propose a novel method, i.e., S2S, for effectively and efficiently learning from the N ary relational data. Specifically, we propose a new tensor decomposition framework, which allows embedding sharing to learn from facts with mixed arity. Since the core tensors may still suffer from the over parameterization, we propose to reduce parameters by sparsifying the core tensors while retaining their expressive power using neural architecture search (NAS) techniques, which can search for data dependent architectures. As a result, the proposed S2S not only guarantees to be expressive but also efficiently learns from mixed arity. Finally, empirical results have demonstrated that S2S is efficient to train and achieves state of the art performance.


Regular Model Checking Approach to Knowledge Reasoning over Parameterized Systems (technical report). We present a general framework for modelling and verifying epistemic properties over parameterized multi agent systems that communicate by truthful public announcements. In our framework, the number of agents or the amount of certain resources are parameterized (i.e. not known a priori), and the corresponding verification problem asks whether a given epistemic property is true regardless of the instantiation of the parameters. For example, in a muddy children puzzle, one could ask whether each child will eventually find out whether (s)he is muddy, regardless of the number of children. Our framework is regular model checking (RMC) based, wherein synchronous finite state automata (equivalently, monadic second order logic over words) are used to specify the systems. We propose an extension of public announcement logic as specification language. Of special interests is the addition of the so called iterated public announcement operators, which are crucial for reasoning about knowledge in parameterized systems. Although the operators make the model checking problem undecidable, we show that this becomes decidable when an appropriate "disappearance relation" is given. Further, we show how Angluin's L algorithm for learning finite automata can be applied to find a disappearance relation, which is guaranteed to terminate if it is regular. We have implemented the algorithm and apply this to such examples as the Muddy Children Puzzle, the Russian Card Problem, and Large Number Challenge.


Support theory for Drinfeld doubles of some infinitesimal group schemes. Consider a Frobenius kernel G in a split semisimple algebraic group, in very good characteristic. We provide an analysis of support for the Drinfeld center Z(rep(G)) of the representation category for G, or equivalently for the representation category of the Drinfeld double of kG. We show that thick ideals in the corresponding stable category are classified by cohomological support, and calculate the Balmer spectrum of the stable category of Z(rep(G)). We also construct a pi point style rank variety for the Drinfeld double, identify pi point support with cohomological support, and show that both support theories satisfy the tensor product property. Our results hold, more generally, for Drinfeld doubles of Frobenius kernels in any smooth algebraic group which admits a quasi logarithm, such as a Borel subgroup in a split semisimple group in very good characteristic.


Open problems in the wild McKay correspondence and related fields. The wild McKay correspondence is a form of McKay correspondence in terms of stringy invariants that is generalized to arbitrary characteristics. It gives rise to an interesting connection between the geometry of wild quotient varieties and arithmetic on extensions of local fields. The principal purpose of this article is to collect open problems on the wild McKay correspondence, as well as those in related fields that the author believes are interesting or important. It also serves as a survey on the present state of these fields.


Levels of Autonomous Radiology. Radiology, being one of the younger disciplines of medicine with a history of just over a century, has witnessed tremendous technological advancements and has revolutionized the way we practice medicine today. In the last few decades, medical imaging modalities have generated seismic amounts of medical data. The development and adoption of Artificial Intelligence (AI) applications using this data will lead to the next phase of evolution in radiology. It will include automating laborious manual tasks such as annotations, report generation, etc., along with the initial radiological assessment of cases to aid radiologists in their evaluation workflow. We propose a level wise classification for the progression of automation in radiology, explaining AI assistance at each level with corresponding challenges and solutions. We hope that such discussions can help us address the challenges in a structured way and take the necessary steps to ensure the smooth adoption of new technologies in radiology.


On Doctrines and Cartesian Bicategories. We study the relationship between cartesian bicategories and a specialisation of Lawvere's hyperdoctrines, namely elementary existential doctrines. Both provide different ways of abstracting the structural properties of logical systems the former in algebraic terms based on a string diagrammatic calculus, the latter in universal terms using the fundamental notion of adjoint functor. We prove that these two approaches are related by an adjunction, which can be strengthened to an equivalence by imposing further constraints on doctrines.


On the Importance of Regularisation Auxiliary Information in OOD Detection. Neural networks are often utilised in critical domain applications (e.g. self driving cars, financial markets, and aerospace engineering), even though they exhibit overconfident predictions for ambiguous inputs. This deficiency demonstrates a fundamental flaw indicating that neural networks often overfit on spurious correlations. To address this problem in this work we present two novel objectives that improve the ability of a network to detect out of distribution samples and therefore avoid overconfident predictions for ambiguous inputs. We empirically demonstrate that our methods outperform the baseline and perform better than the majority of existing approaches, while performing competitively those that they don't outperform. Additionally, we empirically demonstrate the robustness of our approach against common corruptions and demonstrate the importance of regularisation and auxiliary information in out of distribution detection.


Directional differentiability, coexhausters, codifferentials and polyhedral DC functions. Codifferentials and coexhausters are used to describe nonhomogeneous approximations of a nonsmooth function. Despite the fact that coexhausters are modern generalizations of codifferentials, the theories of these two concepts continue to develop simultaneously. Moreover, codifferentials and coexhausters are strongly connected with DC functions. In this paper we trace analogies between all these objects, and prove the equivalence of the boundedness and optimality conditions described in terms of these notions. This allows one to extend the results derived in terms of one object to the problems stated via the other one. Another contribution of this paper is the study of connection between nonhomogeneous approximations and directional derivatives and formulate optimality conditions in terms of nonhomogeneous approximations.


An accelerated minimax algorithm for convex concave saddle point problems with nonsmooth coupling function. In this work we aim to solve a convex concave saddle point problem, where the convex concave coupling function is smooth in one variable and nonsmooth in the other and not assumed to be linear in either. The problem is augmented by a nonsmooth regulariser in the smooth component. We propose and investigate a novel algorithm under the name of OGAProx, consisting of an optimistic gradient ascent step in the smooth variable coupled with a proximal step of the regulariser, and which is alternated with a proximal step in the nonsmooth component of the coupling function. We consider the situations convex concave, convex strongly concave and strongly convex strongly concave related to the saddle point problem under investigation. Regarding iterates we obtain (weak) convergence, a convergence rate of order mathcal O ( frac 1 K ) and linear convergence like mathcal O ( theta K ) with theta 1 , respectively. In terms of function values we obtain ergodic convergence rates of order mathcal O ( frac 1 K ) , mathcal O ( frac 1 K 2 ) and mathcal O ( theta K ) with theta 1 , respectively. We validate our theoretical considerations on a nonsmooth linear saddle point problem, the training of multi kernel support vector machines and a classification problem incorporating minimax group fairness.


Active Hybrid Classification. Hybrid crowd machine classifiers can achieve superior performance by combining the cost effectiveness of automatic classification with the accuracy of human judgment. This paper shows how crowd and machines can support each other in tackling classification problems. Specifically, we propose an architecture that orchestrates active learning and crowd classification and combines them in a virtuous cycle. We show that when the pool of items to classify is finite we face learning vs. exploitation trade off in hybrid classification, as we need to balance crowd tasks optimized for creating a training dataset with tasks optimized for classifying items in the pool. We define the problem, propose a set of heuristics and evaluate the approach on three real world datasets with different characteristics in terms of machine and crowd classification performance, showing that our active hybrid approach significantly outperforms baselines.


A Riemannian Metric for Geometry Aware Singularity Avoidance by Articulated Robots. Articulated robots such as manipulators increasingly must operate in uncertain and dynamic environments where interaction (with human coworkers, for example) is necessary. In these situations, the capacity to quickly adapt to unexpected changes in operational space constraints is essential. At certain points in a manipulator's configuration space, termed singularities, the robot loses one or more degrees of freedom (DoF) and is unable to move in specific operational space directions. The inability to move in arbitrary directions in operational space compromises adaptivity and, potentially, safety. We introduce a geometry aware singularity index, defined using a Riemannian metric on the manifold of symmetric positive definite matrices, to provide a measure of proximity to singular configurations. We demonstrate that our index avoids some of the failure modes and difficulties inherent to other common indices. Further, we show that this index can be differentiated easily, making it compatible with local optimization approaches used for operational space control. Our experimental results establish that, for reaching and path following tasks, optimization based on our index outperforms a common manipulability maximization technique and ensures singularity robust motions.


Dependent Stopping Times. Stopping times are used in applications to model random arrivals. A standard assumption in many models is that they are conditionally independent, given an underlying filtration. This is a widely useful assumption, but there are circumstances where it seems to be unnecessarily strong. We use a modified Cox construction along with the bivariate exponential introduced by Marshall and Olkin (1967) to create a family of stopping times, which are not necessarily conditionally independent, allowing for a positive probability for them to be equal. We indicate applications to modeling COVID 19 contagion (and epidemics in general), civil engineering, and to credit risk.


Deep Dual resolution Networks for Real time and Accurate Semantic Segmentation of Road Scenes. Semantic segmentation is a key technology for autonomous vehicles to understand the surrounding scenes. The appealing performances of contemporary models usually come at the expense of heavy computations and lengthy inference time, which is intolerable for self driving. Using light weight architectures (encoder decoder or two pathway) or reasoning on low resolution images, recent methods realize very fast scene parsing, even running at more than 100 FPS on a single 1080Ti GPU. However, there is still a significant gap in performance between these real time methods and the models based on dilation backbones. To tackle this problem, we proposed a family of efficient backbones specially designed for real time semantic segmentation. The proposed deep dual resolution networks (DDRNets) are composed of two deep branches between which multiple bilateral fusions are performed. Additionally, we design a new contextual information extractor named Deep Aggregation Pyramid Pooling Module (DAPPM) to enlarge effective receptive fields and fuse multi scale context based on low resolution feature maps. Our method achieves a new state of the art trade off between accuracy and speed on both Cityscapes and CamVid dataset. In particular, on a single 2080Ti GPU, DDRNet 23 slim yields 77.4 mIoU at 102 FPS on Cityscapes test set and 74.7 mIoU at 230 FPS on CamVid test set. With widely used test augmentation, our method is superior to most state of the art models and requires much less computation. Codes and trained models are available online.


Putting Words in BERT's Mouth Navigating Contextualized Vector Spaces with Pseudowords. We present a method for exploring regions around individual points in a contextualized vector space (particularly, BERT space), as a way to investigate how these regions correspond to word senses. By inducing a contextualized "pseudoword" as a stand in for a static embedding in the input layer, and then performing masked prediction of a word in the sentence, we are able to investigate the geometry of the BERT space in a controlled manner around individual instances. Using our method on a set of carefully constructed sentences targeting ambiguous English words, we find substantial regularity in the contextualized space, with regions that correspond to distinct word senses but between these regions there are occasionally "sense voids" regions that do not correspond to any intelligible sense.


A Large Pairwise Far Family of Aronszajn Trees. We construct a large family of normal kappa complete mathbb R kappa embeddable kappa Aronszajn trees which have no club isomorphic subtrees using an instance of the proxy principle of Brodsky Rinot.


IFBiD Inference Free Bias Detection. This paper is the first to explore an automatic way to detect bias in deep convolutional neural networks by simply looking at their weights. Furthermore, it is also a step towards understanding neural networks and how they work. We show that it is indeed possible to know if a model is biased or not simply by looking at its weights, without the model inference for an specific input. We analyze how bias is encoded in the weights of deep networks through a toy example using the Colored MNIST database and we also provide a realistic case study in gender detection from face images using state of the art methods and experimental resources. To do so, we generated two databases with 36K and 48K biased models each. In the MNIST models we were able to detect whether they presented a strong or low bias with more than 99 accuracy, and we were also able to classify between four levels of bias with more than 70 accuracy. For the face models, we achieved 90 accuracy in distinguishing between models biased towards Asian, Black, or Caucasian ethnicity.


Central Open Sets Tilings. We introduce a method for constructing collections of subsets of mathbb R n , using an iterated function system, a set T, and a cost function. We refer to these collections as tilings. The special case where T is the central open set of an iterated function system that obeys the open set condition is emphasized. The notion of the central open set associated with an iterated function system of similitudes, introduced in 2005 by Bandt, Hung, and Rao, is reviewed. A practical method for calculating pictures of central open sets is described. Some general properties and examples of the tilings are presented.


Spread of infections in a heterogeneous moving population. We consider a model where an infection moves through a collection of particles performing independent random walks. In this model, Kesten and Sidoravicius established linear growth of the infected region when infected and susceptible particles move at the same speed. In this paper we establish a linear growth rate when infected and susceptible particles move at different speeds, answering an open problem from their work. Our proof combines an intricate coupling of Poisson processes with a streamlined version of a percolation model of Sidoravicius and Stauffer.


On the Efficient Design of Network Resilient to Electro Magnetic Pulse Attack Elastic Optical Network Case Study. The telecommunication networks have become an indispensable part of our everyday life, providing support for such important areas as business, education, health care, finances, entertainment and social life. Alongside their continuous and uninterrupted operation is required while numerous new threats and attack scenarios emerge. The international security organisations warn against increasing likelihood of nuclear weapon or electro magnetic pulse (EMP) attacks, which can be extremely harmful also for transport networks. On that background, we study efficient design of network resilient to EMP attack wherein the required protection level is provided by the application of multipath routing and military grade bunkers (advanced electro magnetic radiation resilient approaches protecting whole network node) implementation. Formally, we define and study problem of bunkers location, routing and spectrum allocation (BLRSA) in elastic optical network (EON). In the problem objective we address two criteria network resilience (measured by the average lost flow per potential attack) and spectrum usage. For that problem we propose integer linear programming (ILP) model and two dedicated heuristics 1S RSA and 2S RSA. Then, we perform extensive numerical experiments divided into three parts (i) tuning of the proposed approaches, (ii) comparison with reference methods, (iii) realistic case study efficient EMP resilient network design. In the case study we analyze benefits and costs of the proposed protection scheme. Moreover, we also analyze vulnerabilities of three realistic network topologies to EMP attacks and identify their critical nodes. The investigation proves high efficiency of the proposed approaches and shows that they allow to save up to 90 of traffic lost in the case of no protection against these types of attacks.


Multi View Radar Semantic Segmentation. Understanding the scene around the ego vehicle is key to assisted and autonomous driving. Nowadays, this is mostly conducted using cameras and laser scanners, despite their reduced performances in adverse weather conditions. Automotive radars are low cost active sensors that measure properties of surrounding objects, including their relative speed, and have the key advantage of not being impacted by rain, snow or fog. However, they are seldom used for scene understanding due to the size and complexity of radar raw data and the lack of annotated datasets. Fortunately, recent open sourced datasets have opened up research on classification, object detection and semantic segmentation with raw radar signals using end to end trainable models. In this work, we propose several novel architectures, and their associated losses, which analyse multiple "views" of the range angle Doppler radar tensor to segment it semantically. Experiments conducted on the recent CARRADA dataset demonstrate that our best model outperforms alternative models, derived either from the semantic segmentation of natural images or from radar scene understanding, while requiring significantly fewer parameters. Both our code and trained models are available at https github.com valeoai MVRSS.


DATE Detecting Anomalies in Text via Self Supervision of Transformers. Leveraging deep learning models for Anomaly Detection (AD) has seen widespread use in recent years due to superior performances over traditional methods. Recent deep methods for anomalies in images learn better features of normality in an end to end self supervised setting. These methods train a model to discriminate between different transformations applied to visual data and then use the output to compute an anomaly score. We use this approach for AD in text, by introducing a novel pretext task on text sequences. We learn our DATE model end to end, enforcing two independent and complementary self supervision signals, one at the token level and one at the sequence level. Under this new task formulation, we show strong quantitative and qualitative results on the 20Newsgroups and AG News datasets. In the semi supervised setting, we outperform state of the art results by 13.5 and 6.9 , respectively (AUROC). In the unsupervised configuration, DATE surpasses all other methods even when 10 of its training data is contaminated with outliers (compared with 0 for the others).


Annotation Guidelines for the Turku Paraphrase Corpus. This document describes the annotation guidelines used to construct the Turku Paraphrase Corpus. These guidelines were developed together with the corpus annotation, revising and extending the guidelines regularly during the annotation work. Our paraphrase annotation scheme uses the base scale 1 4, where labels 1 and 2 are used for negative candidates (not paraphrases), while labels 3 and 4 are paraphrases at least in the given context if not everywhere. In addition to base labeling, the scheme is enriched with additional subcategories (flags) for categorizing different types of paraphrases inside the two positive labels, making the annotation scheme suitable for more fine grained paraphrase categorization. The annotation scheme is used to annotate over 100,000 Finnish paraphrase pairs.


Fractal Dimension and Retinal Pathology A Meta analysis. Due to the fractal nature of retinal blood vessels, the retinal fractal dimension is a natural parameter for researchers to explore and has garnered interest as a potential diagnostic tool. This review aims to summarize the current scientific evidence regarding the relationship between fractal dimension and retinal pathology and thus assess the clinical value of retinal fractal dimension. Following the PRISMA guidelines, a literature search for research articles was conducted in several internet databases (Embase, PubMed, Web of Science, Scopus). This led to a result of 28 studies included in the final review, which were analyzed via meta analysis to determine whether the fractal dimension changes significantly in retinal disease versus normal individuals


Stark control of a chiral fluoroethylene derivative. Hydrogen dissociation is an unwanted competing pathway if a torsional motion around the C C double bond in a chiral fluoroethylene derivative, namely (4 methylcyclohexylidene) fluoromethane (4MCF), is to be achieved. We show that the excited state H dissociation can be drastically diminished on timescales long enough to initiate a torsion around the C C double bond using the non resonant dynamic Stark effect. Potential energy curves, dipoles and polarizabilities for the regarded one dimensional reaction coordinate are calculated within the CASSCF method. The influence of the excitation and the laser control field is then simulated using wavepacket dynamics.


Learning to Learn to be Right for the Right Reasons. Improving model generalization on held out data is one of the core objectives in commonsense reasoning. Recent work has shown that models trained on the dataset with superficial cues tend to perform well on the easy test set with superficial cues but perform poorly on the hard test set without superficial cues. Previous approaches have resorted to manual methods of encouraging models not to overfit to superficial cues. While some of the methods have improved performance on hard instances, they also lead to degraded performance on easy instances. Here, we propose to explicitly learn a model that does well on both the easy test set with superficial cues and hard test set without superficial cues. Using a meta learning objective, we learn such a model that improves performance on both the easy test set and the hard test set. By evaluating our models on Choice of Plausible Alternatives (COPA) and Commonsense Explanation, we show that our proposed method leads to improved performance on both the easy test set and the hard test set upon which we observe up to 16.5 percentage points improvement over the baseline.


Boosting Image Outpainting with Semantic Layout Prediction. The objective of image outpainting is to extend image current border and generate new regions based on known ones. Previous methods adopt generative adversarial networks (GANs) to synthesize realistic images. However, the lack of explicit semantic representation leads to blurry and abnormal image pixels when the outpainting areas are complex and with various objects. In this work, we decompose the outpainting task into two stages. Firstly, we train a GAN to extend regions in semantic segmentation domain instead of image domain. Secondly, another GAN model is trained to synthesize real images based on the extended semantic layouts. The first model focuses on low frequent context such as sizes, classes and other semantic cues while the second model focuses on high frequent context like color and texture. By this design, our approach can handle semantic clues more easily and hence works better in complex scenarios. We evaluate our framework on various datasets and make quantitative and qualitative analysis. Experiments demonstrate that our method generates reasonable extended semantic layouts and images, outperforming state of the art models.


SMT Based Safety Verification of Data Aware Processes under Ontologies (Extended Version). In the context of verification of data aware processes (DAPs), a formal approach based on satisfiability modulo theories (SMT) has been considered to verify parameterised safety properties of so called artifact centric systems. This approach requires a combination of model theoretic notions and algorithmic techniques based on backward reachability. We introduce here a variant of one of the most investigated models in this spectrum, namely simple artifact systems (SASs), where, instead of managing a database, we operate over a description logic (DL) ontology expressed in (a slight extension of) RDFS. This DL, enjoying suitable model theoretic properties, allows us to define DL based SASs to which backward reachability can still be applied, leading to decidability in PSPACE of the corresponding safety problems.


On the singularities and on the projective normality of some Enriques Fano threefolds. In order to find useful information to complete the classification of Enriques Fano threefolds, we will computationally study the singularities of some known Enriques Fano threefolds of genus 6, 7, 8, 9, 10, 13 and 17. We will also deduce the projective normality of these threefolds.


On some sums involving the integral part function. Denote by tau k (n), omega (n) and mu 2 (n) the number of representations of n as product of k natural numbers, the number of distinct prime factors of n and the characteristic function of the square free integers, respectively. Let t be the integral part of real number t. For f omega , 2 omega , mu 2 , tau k , we prove that n x f x n x d 1 f (d) d(d 1) O epsilon (x theta f epsilon ) for x rightarrow infty , where theta omega 53 110 , theta 2 omega 9 19 , theta mu 2 2 5 , theta tau k 5k 1 10k 1 and epsilon 0 is an arbitrarily small positive number. These improve the corresponding results of Bordell e s.


Shear based gap control in 2D photonic quasicrystals of dielectric cylinders. 2D dielectric photonic quasicrystals can be designed to show isotropic band gaps. The system here studied is a quasiperiodic lattice made of silicon dielectric cylinders arranged as periodic unit cell based on a decagonal approximant of a quasiperiodic Penrose lattice. We analyze the bulk properties of the resulting lattice as well as the bright states excited in the gap which correspond to localized resonances of the electromagnetic field in specific cylinder clusters of the lattice. Then we introduce a controlled shear deformation which breaks the decagonal symmetry and evaluate the width reduction of the gap together with the evolution of the resonances, for all shear values compatible with physical constraints (cylinder collision). The gap is reduced up to a 18.5 while different states change their frequency in different ways. Realistic analysis about the actual transmission of the electromagnetic radiation, often missing in the literature, have been performed for a finite slice of the proposed quasicrystals structure. Two calculation procedures based on MIT Photonic Bands (MPB) and Finite Integration Technique (FIT) are used for the bulk and the finite structures finding an extremely good agreement among them.


Sandpile groups of supersingular isogeny graphs. Let p and q be distinct primes, and let X p,q be the (q 1) regular graph whose nodes are supersingular elliptic curves over overline mathbb F p and whose edges are q isogenies. For fixed p , we compute the distribution of the ell Sylow subgroup of the sandpile group (i.e. Jacobian) of X p,q as q to infty . We find that the distribution disagrees with the Cohen Lenstra heuristic in this context. Our proof is via Galois representations attached to modular curves. As a corollary of our result, we give an upper bound on the probability that the Jacobian is cyclic, which we conjecture to be sharp.


Comparison results for Poisson equation with mixed boundary condition on manifolds. In this article, we study Talenti's comparison results for Poisson equation with mixed boundary condition on manifolds. Precisely, using symmetrization techniques and isoperimetric inequalities, we establish a L 1 estimate for solutions to Poisson equation with mixed boundary condition, on complete noncompact manifolds with nonnegative Ricci curvature and compact manifolds with positive Ricci curvature respectively. Particularly, on Riemann surfaces we obtain a Talenti's comparison result. Our results generalize the main theorems in ACNT21 to Riemannian setting.


Deformable Graph Convolutional Networks. Graph neural networks (GNNs) have significantly improved the representation power for graph structured data. Despite of the recent success of GNNs, the graph convolution in most GNNs have two limitations. Since the graph convolution is performed in a small local neighborhood on the input graph, it is inherently incapable to capture long range dependencies between distance nodes. In addition, when a node has neighbors that belong to different classes, i.e., heterophily, the aggregated messages from them often negatively affect representation learning. To address the two common problems of graph convolution, in this paper, we propose Deformable Graph Convolutional Networks (Deformable GCNs) that adaptively perform convolution in multiple latent spaces and capture short long range dependencies between nodes. Separated from node representations (features), our framework simultaneously learns the node positional embeddings (coordinates) to determine the relations between nodes in an end to end fashion. Depending on node position, the convolution kernels are deformed by deformation vectors and apply different transformations to its neighbor nodes. Our extensive experiments demonstrate that Deformable GCNs flexibly handles the heterophily and achieve the best performance in node classification tasks on six heterophilic graph datasets.


A lower bound on the average genus of a 2 bridge knot. Experimental data from Dunfield et al using random grid diagrams suggests that the genus of a knot grows linearly with respect to the crossing number. Using billiard table diagrams of Chebyshev knots developed by Koseleff and Pecker and a random model of 2 bridge knots via these diagrams developed by the author with Krishnan and then with Even Zohar and Krishnan, we introduce a further truncated model of all 2 bridge knots of a given crossing number, almost all counted twice. We present a convenient way to count Seifert circles in this model and use this to compute a lower bound for the average Seifert genus of a 2 bridge knot of a given crossing number.


Machine Translation, Sentiment Analysis, Text Similarity, Topic Modelling, and Tweets Understanding Social Media Usage Among Police and Gendarmerie Organizations. It is well known that social media has revolutionized communication. Nowadays, citizens, companies, and public institutions actively use social media in order to express themselves better to the population they address. This active use is also carried out by the gendarmerie and police organizations to communicate with the public with the purpose of improving social relations. However, it has been seen that the posts by the gendarmerie and police organizations did not attract much attention from their target audience from time to time, and it has been discovered that there was not enough research in the literature on this issue. In this study, it was aimed to investigate the use of social media by the gendarmerie and police organizations operating in Turkey (Jandarma Polis), Italy (Carabinieri Polizia), France (Gendarmerie Police) and Spain (Guardia Civil Polic 'ia), and the extent to which they can be effective on the followers, by comparatively examining their activity on twitter. According to the obtained results, it was found that Jandarma (Turkey) has the highest power of influence in the twitter sample, and the findings were comparatively presented in the study.


Finite image property of weighted tree automata over past finite monotonic strong bimonoids. We consider weighted tree automata over strong bimonoids (for short wta). A wta mathcal A has the finite image property if its recognized weighted tree language ! mathcal A ! has finite image moreover, mathcal A has the preimage property if the preimage under ! mathcal A ! of each element of the underlying strong bimonoid is a recognizable tree language. For each wta mathcal A over a past finite monotonic strong bimonoid we prove the following results. In terms of mathcal A 's structural properties, we characterize whether it has the finite image property. We characterize those past finite monotonic strong bimonoids such that for each wta mathcal A it is decidable whether mathcal A has the finite image property. In particular, the finite image property is decidable for wta over past finite monotonic semirings. Moreover, we prove that mathcal A has the preimage property. All our results also hold for weighted string automata.


Deep neural network loses attention to adversarial images. Adversarial algorithms have shown to be effective against neural networks for a variety of tasks. Some adversarial algorithms perturb all the pixels in the image minimally for the image classification task in image classification. In contrast, some algorithms perturb few pixels strongly. However, very little information is available regarding why these adversarial samples so diverse from each other exist. Recently, Vargas et al. showed that the existence of these adversarial samples might be due to conflicting saliency within the neural network. We test this hypothesis of conflicting saliency by analysing the Saliency Maps (SM) and Gradient weighted Class Activation Maps (Grad CAM) of original and few different types of adversarial samples. We also analyse how different adversarial samples distort the attention of the neural network compared to original samples. We show that in the case of Pixel Attack, perturbed pixels either calls the network attention to themselves or divert the attention from them. Simultaneously, the Projected Gradient Descent Attack perturbs pixels so that intermediate layers inside the neural network lose attention for the correct class. We also show that both attacks affect the saliency map and activation maps differently. Thus, shedding light on why some defences successful against some attacks remain vulnerable against other attacks. We hope that this analysis will improve understanding of the existence and the effect of adversarial samples and enable the community to develop more robust neural networks.


Fully developed anelastic convection with no slip boundaries. Anelastic convection at high Rayleigh number in a plane parallel layer with no slip boundaries is considered. Energy and entropy balance equations are derived, and they are used to develop scaling laws for the heat transport and the Reynolds number. The appearance of an entropy structure consisting of a well mixed uniform interior, bounded by thin layers with entropy jumps across them, makes it possible to derive explicit forms for these scaling laws. These are given in terms of the Rayleigh number, the Prandtl number, and the bottom to top temperature ratio, which measures how stratified the layer is. The top and bottom boundary layers are examined and they are found to be very different, unlike in the Boussinesq case. Elucidating the structure of these boundary layers plays a crucial part in determining the scaling laws. Physical arguments governing these boundary layers are presented, concentrating on the case in which the boundary layers are thin even when the stratification is large, the incompressible boundary layer case. Different scaling laws are found, depending on whether the viscous dissipation is primarily in the boundary layers or in the bulk. The cases of both high and low Prandtl number are considered. Numerical simulations of no slip anelastic convection up to a Rayleigh number of 10 7 have been performed and our theoretical predictions are compared with the numerical results.


Moser Iteration and the Large Coupling Limit. We consider heat semigroups of the form exp(t( Delta lambda mathbf 1 Omega 0 )) on bounded domains. Using variants of Moser iteration, we show sub exponential decay in the large coupling limit", i.e. as lambda nearrow infty , in compact subdomains of the obstacle", Omega 0 .


A note on the discriminant of reflection Hopf algebras. We provide a formula for commputing the discriminant of skew Calabi Yau algebra over a central Calabi Yau algebra. This method is applied to study the Jacobian and discriminant for reflection Hopf algebras.


Investigating Math Word Problems using Pretrained Multilingual Language Models. In this paper, we revisit math word problems (MWPs) from the cross lingual and multilingual perspective. We construct our MWP solvers over pretrained multilingual language models using sequence to sequence model with copy mechanism. We compare how the MWP solvers perform in cross lingual and multilingual scenarios. To facilitate the comparison of cross lingual performance, we first adapt the large scale English dataset MathQA as a counterpart of the Chinese dataset Math23K. Then we extend several English datasets to bilingual datasets through machine translation plus human annotation. Our experiments show that the MWP solvers may not be transferred to a different language even if the target expressions have the same operator set and constants. But for both cross lingual and multilingual cases, it can be better generalized if problem types exist on both source language and target language.


The Faulhaber formula analytic continuation. We extend the Faulhaber formula to the whole complex plane, obtaining an expression that fully resembles the Euler Maclaurin summation formula, only it's exact. Thereafter, an expression for the generalized harmonic progressions valid in the whole complex plane is also derived. Lastly, we extend a formula for the Hurwitz zeta function valid at the negative integers, zeta( k,b) , to the whole complex plane, following a similar procedure.


Fast Density Estimation for Density based Clustering Methods. Density based clustering algorithms are widely used for discovering clusters in pattern recognition and machine learning since they can deal with non hyperspherical clusters and are robustness to handle outliers. However, the runtime of density based algorithms are heavily dominated by finding fixed radius near neighbors and calculating the density, which is time consuming. Meanwhile, the traditional acceleration methods using indexing technique such as KD tree is not effective in processing high dimensional data. In this paper, we propose a fast region query algorithm named fast principal component analysis pruning (called FPCAP) with the help of the fast principal component analysis technique in conjunction with geometric information provided by principal attributes of the data, which can process high dimensional data and be easily applied to density based methods to prune unnecessary distance calculations when finding neighbors and estimating densities. As an application in density based clustering methods, FPCAP method was combined with the Density Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm. And then, an improved DBSCAN (called IDBSCAN) is obtained, which preserves the advantage of DBSCAN and meanwhile, greatly reduces the computation of redundant distances. Experiments on seven benchmark datasets demonstrate that the proposed algorithm improves the computational efficiency significantly.


Anytime informed path re planning and optimization for robots in changing environments. In this paper, we propose a path re planning algorithm that makes robots able to work in scenarios with moving obstacles. The algorithm switches between a set of pre computed paths to avoid collisions with moving obstacles. It also improves the current path in an anytime fashion. The use of informed sampling enhances the search speed. Numerical results show the effectiveness of the strategy in different simulation scenarios.


Covariance Matrix Adaptation Evolution Strategy Assisted by Principal Component Analysis. Over the past decades, more and more methods gain a giant development due to the development of technology. Evolutionary Algorithms are widely used as a heuristic method. However, the budget of computation increases exponentially when the dimensions increase. In this paper, we will use the dimensionality reduction method Principal component analysis (PCA) to reduce the dimension during the iteration of Covariance Matrix Adaptation Evolution Strategy (CMA ES), which is a good Evolutionary Algorithm that is presented as the numeric type and useful for different kinds of problems. We assess the performance of our new methods in terms of convergence rate on multi modal problems from the Black Box Optimization Benchmarking (BBOB) problem set and we also use the framework COmparing Continuous Optimizers (COCO) to see how the new method going and compare it to the other algorithms.


Improved approximations of resolvents in homogenization of fourth order operators with periodic coefficients. In the whole space R d , d ge 2 , we study homogenization of a divergence form elliptic fourth order operator A varepsilon with measurable varepsilon periodic coefficients, where varepsilon is a small parameter. For the resolvent (A varepsilon 1) 1 , acting as an operator from L 2 to H 2 , we find an approximation with remainder term of order O( varepsilon 2) as varepsilon tends to 0 . Relying on this result, we construct the resolvent approximation with remainder of order O( varepsilon 3) in the operator L 2 norm. We employ two scale expansions that involve smoothing.


The contact process over a dynamical d regular graph. We consider the contact process on a dynamic graph defined as a random d regular graph with a stationary edge switching dynamics. In this graph dynamics, independently of the contact process state, each pair e 1,e 2 of edges of the graph is replaced by new edges e 1',e 2' in a crossing fashion each of e 1',e 2' contains one vertex of e 1 and one vertex of e 2 . As the number of vertices of the graph is taken to infinity, we scale the rate of switching in a way that any fixed edge is involved in a switching with a rate that approaches a limiting value mathsf v , so that locally the switching is seen in the same time scale as that of the contact process. We prove that if the infection rate of the contact process is above a threshold value bar lambda (depending on d and mathsf v ), then the infection survives for a time that grows exponentially with the size of the graph. By proving that bar lambda is strictly smaller than the lower critical infection rate of the contact process on the infinite d regular tree, we show that there are values of lambda for which the infection dies out in logarithmic time in the static graph but survives exponentially long in the dynamic graph.


VidLanKD Improving Language Understanding via Video Distilled Knowledge Transfer. Since visual perception can give rich information beyond text descriptions for world understanding, there has been increasing interest in leveraging visual grounding for language learning. Recently, vokenization (Tan and Bansal, 2020) has attracted attention by using the predictions of a text to image retrieval model as labels for language model supervision. Despite its success, the method suffers from approximation error of using finite image labels and the lack of vocabulary diversity of a small image text dataset. To overcome these limitations, we present VidLanKD, a video language knowledge distillation method for improving language understanding. We train a multi modal teacher model on a video text dataset, and then transfer its knowledge to a student language model with a text dataset. To avoid approximation error, we propose to use different knowledge distillation objectives. In addition, the use of a large scale video text dataset helps learn diverse and richer vocabularies. In our experiments, VidLanKD achieves consistent improvements over text only language models and vokenization models, on several downstream language understanding tasks including GLUE, SQuAD, and SWAG. We also demonstrate the improved world knowledge, physical reasoning, and temporal reasoning capabilities of our model by evaluating on the GLUE diagnostics, PIQA, and TRACIE datasets. Lastly, we present comprehensive ablation studies as well as visualizations of the learned text to video grounding results of our teacher and student language models. Our code and models are available at https github.com zinengtang VidLanKD


Balanced Hyperbolic and Divisorially Hyperbolic Compact Complex Manifolds. We introduce two notions of hyperbolicity for not necessarily K "ahler n dimensional compact complex manifolds X . The first, called it balanced hyperbolicity , generalises Gromov's K "ahler hyperbolicity by means of Gauduchon's balanced metrics. The second, called it divisorial hyperbolicity , generalises the Brody hyperbolicity by ruling out the existence of non degenerate holomorphic maps from C n 1 to X that have what we term a subexponential growth. Our main result in the first part of the paper asserts that every balanced hyperbolic X is also divisorially hyperbolic. We provide a certain number of examples and counter examples and discuss various properties of these manifolds. In the second part of the paper, we introduce the notions of it divisorially K "ahler and it divisorially nef real De Rham cohomology classes of degree 2 and study their properties. They also apply to C infty , not necessarily holomorphic, complex line bundles and are expected to be implied in certain cases by the hyperbolicity properties introduced in the first part of the work. While motivated by the observation of hyperbolicity properties of certain non K "ahler manifolds, all these four new notions seem to have a role to play even in the K "ahler and the projective settings.


Machines as Programs P neq NP. The Curry Howard correspondence is often called the proofs as programs result. I offer a generalization of this result, something which may be called machines as programs. Utilizing this insight, I introduce two new Turing Machines called "Ceiling Machines." The formal ingredients of these two machines are nearly identical. But there are crucial differences, splitting the two into a "Higher Ceiling Machine" and a "Lower Ceiling Machine." A potential graph of state transitions of the Higher Ceiling Machine is then offered. This graph is termed the "canonically nondeterministic solution" or CNDS, whose accompanying problem is its own replication, i.e., the problem, "Replicate CNDS" (whose accompanying algorithm is cast in Martin L "of type theory). I then show that while this graph can be replicated (solved) in polynomial time by a nondeterministic machine of which the Higher Ceiling Machine is a canonical example it cannot be solved in polynomial time by a deterministic machine, of which the Lower Ceiling Machine is also canonical. It is consequently proven that P neq NP.


Immersive virtual reality methods in cognitive neuroscience and neuropsychology Meeting the criteria of the National Academy of Neuropsychology and American Academy of Clinical Neuropsychology. Clinical tools involving immersive virtual reality (VR) may bring several advantages to cognitive neuroscience and neuropsychology. However, there are some technical and methodological pitfalls. The American Academy of Clinical Neuropsychology (AACN) and the National Academy of Neuropsychology (NAN) raised 8 key issues pertaining to Computerized Neuropsychological Assessment Devices. These issues pertain to (1) the safety and effectivity (2) the identity of the end user (3) the technical hardware and software features (4) privacy and data security (5) the psychometric properties (6) examinee issues (7) the use of reporting services and (8) the reliability of the responses and results. The VR Everyday Assessment Lab (VR EAL) is the first immersive VR neuropsychological battery with enhanced ecological validity for the assessment of everyday cognitive functions by offering a pleasant testing experience without inducing cybersickness. The VR EAL meets the criteria of the NAN and AACN, addresses the methodological pitfalls, and brings advantages for neuropsychological testing. However, there are still shortcomings of the VR EAL, which should be addressed. Future iterations should strive to improve the embodiment illusion in VR EAL and the creation of an open access VR software library should be attempted. The discussed studies demonstrate the utility of VR methods in cognitive neuroscience and neuropsychology.


Traveling waves of an FKPP type model for self organized growth. We consider a reaction diffusion system of densities of two types of particles, introduced by Edouard Hannezo et al. in the context of branching morphogenesis. It is a simple model for a growth process active, branching particles form the growing boundary layer of an otherwise static tissue, represented by inactive particles (Cell, 171(1) 242 255.e27, 2017). The active particles diffuse, branch and become irreversibly inactive upon collision with a particle of arbitrary type. In absence of active particles, this system is in a steady state, without any a priori restriction on the amount of remaining inactive particles. Thus, while related to the well studied FKPP equation, this system features a game changing continuum of steady state solutions, where each corresponds to a possible outcome of the growth process. However, simulations indicate that this system self organizes traveling fronts with fixed shape arise under a wide range of initial data. In the present work, we describe all positive and bounded traveling wave solutions, and obtain necessary and sufficient conditions for their existence. We find a surprisingly simple symmetry in the pairs of steady states which are joined via heteroclinic wave orbits. Our approach is constructive we first prove the existence of almost constant solutions and then extend our results via a continuity argument along the continuum of limiting points.


Behavior Driven Synthesis of Human Dynamics. Generating and representing human behavior are of major importance for various computer vision applications. Commonly, human video synthesis represents behavior as sequences of postures while directly predicting their likely progressions or merely changing the appearance of the depicted persons, thus not being able to exercise control over their actual behavior during the synthesis process. In contrast, controlled behavior synthesis and transfer across individuals requires a deep understanding of body dynamics and calls for a representation of behavior that is independent of appearance and also of specific postures. In this work, we present a model for human behavior synthesis which learns a dedicated representation of human dynamics independent of postures. Using this representation, we are able to change the behavior of a person depicted in an arbitrary posture, or to even directly transfer behavior observed in a given video sequence. To this end, we propose a conditional variational framework which explicitly disentangles posture from behavior. We demonstrate the effectiveness of our approach on this novel task, evaluating capturing, transferring, and sampling fine grained, diverse behavior, both quantitatively and qualitatively. Project page is available at https cutt.ly 5l7rXEp


A parameter study on optimal scaffolds in a simple model for bone regeneration. We propose a simple model for scaffold aided bone regeneration. In this model, only macroscopic quantities, e.g., locally averaged osteoblast densities, are considered. This allows for use of this model in an optimization algorithm, whose outcome is an optimal scaffold porosity distribution. This optimal scaffold naturally depends on the choice of parameters in the model, and we provide a parameter study with a particular focus on patients with reduced bone regeneration or reduced vascularization capacity.


Shipwright A Human in the Loop System for Dockerfile Repair. Docker is a tool for lightweight OS level virtualization. Docker images are created by performing a build, controlled by a source level artifact called a Dockerfile. We studied Dockerfiles on GitHub, and to our great surprise found that over a quarter of the examined Dockerfiles failed to build (and thus to produce images). To address this problem, we propose SHIPWRIGHT, a human in the loop system for finding repairs to broken Dockerfiles. SHIPWRIGHT uses a modified version of the BERT language model to embed build logs and to cluster broken Dockerfiles. Using these clusters and a search based procedure, we were able to design 13 rules for making automated repairs to Dockerfiles. With the aid of SHIPWRIGHT, we submitted 45 pull requests (with a 42.2 acceptance rate) to GitHub projects with broken Dockerfiles. Furthermore, in a "time travel" analysis of broken Dockerfiles that were later fixed, we found that SHIPWRIGHT proposed repairs that were equivalent to human authored patches in 22.77 of the cases we studied. Finally, we compared our work with recent, state of the art, static Dockerfile analyses, and found that, while static tools detected possible build failure inducing issues in 20.6 33.8 of the files we examined, SHIPWRIGHT was able to detect possible issues in 73.25 of the files and, additionally, provide automated repairs for 18.9 of the files.


A New Approach for Correcting Noncovalent Interactions in Semiempirical Quantum Mechanical Methods. The Importance of Multiple Orientation Sampling. A new approach is presented to improve the performance of semiempirical quantum mechanical (SQM) methods in the description of noncovalent interactions. To show the strategy, the PM6 Hamiltonian was selected, although, in general, the procedure can be applied to other semiempirical Hamiltonians and to different methodologies. In this way, analytical corrections to PM6 were derived from fits to CCSD(T) PM6 interaction energy differences. A set of small molecules was selected as representative of the common functional groups, and intermolecular potential energy curves were evaluated for the most relevant orientations of interacting molecular pairs. The resulting method, called PM6 FGC (from Functional Group Corrections), significantly improves the performance of PM6 and previous corrected SQM methods, and shows the importance of including a sufficient number of orientations of the interacting molecules in the reference data set in order to obtain well balanced descriptions.


Digital Editions as Distant Supervision for Layout Analysis of Printed Books. Archivists, textual scholars, and historians often produce digital editions of historical documents. Using markup schemes such as those of the Text Encoding Initiative and EpiDoc, these digital editions often record documents' semantic regions (such as notes and figures) and physical features (such as page and line breaks) as well as transcribing their textual content. We describe methods for exploiting this semantic markup as distant supervision for training and evaluating layout analysis models. In experiments with several model architectures on the half million pages of the Deutsches Textarchiv (DTA), we find a high correlation of these region level evaluation methods with pixel level and word level metrics. We discuss the possibilities for improving accuracy with self training and the ability of models trained on the DTA to generalize to other historical printed books.