Here To Stay Measuring Hologram Stability in Markerless Smartphone Augmented Reality. Markerless augmented reality (AR) has the potential to provide engaging experiences and improve outcomes across a wide variety of industries the overlaying of virtual content, or holograms, onto a view of the real world without the need for predefined markers provides great convenience and flexibility. However, unwanted hologram movement frequently occurs in markerless smartphone AR due to challenging visual conditions or device movement, and resulting error in device pose tracking. We develop a method for measuring hologram positional errors on commercial smartphone markerless AR platforms, implement it as an open source AR app, HoloMeasure, and use the app to conduct systematic quantitative characterizations of hologram stability across 6 different user actions, 3 different smartphone models, and over 200 different environments. Our study demonstrates significant levels of spatial instability in holograms in all but the simplest settings, and underscores the need for further enhancements to pose tracking algorithms for smartphone based markerless AR.


Secondary Homological Stability for Unordered Configuration Spaces. Secondary homological stability is a recently discovered stability pattern for the homology of a sequence of spaces exhibiting homological stability in a range where homological stability does not hold. We prove secondary homological stability for the homology of the unordered configuration spaces of a connected manifold. The main difficulty is the case that the manifold is closed because there are no obvious maps inducing stability and the homology eventually is periodic instead of stable. We resolve this issue by constructing a new chain level stabilization map for configuration spaces.


Adaptive Dilated Convolution For Human Pose Estimation. Most existing human pose estimation (HPE) methods exploit multi scale information by fusing feature maps of four different spatial sizes, ie 1 4 , 1 8 , 1 16 , and 1 32 of the input image. There are two drawbacks of this strategy 1) feature maps of different spatial sizes may be not well aligned spatially, which potentially hurts the accuracy of keypoint location 2) these scales are fixed and inflexible, which may restrict the generalization ability over various human sizes. Towards these issues, we propose an adaptive dilated convolution (ADC). It can generate and fuse multi scale features of the same spatial sizes by setting different dilation rates for different channels. More importantly, these dilation rates are generated by a regression module. It enables ADC to adaptively adjust the fused scales and thus ADC may generalize better to various human sizes. ADC can be end to end trained and easily plugged into existing methods. Extensive experiments show that ADC can bring consistent improvements to various HPE methods. The source codes will be released for further research.


Comparision between regularity of small symbolic powers and ordinary powers of an edge ideal. Let G be a simple graph and I its edge ideal. We prove that rm reg (I (s) ) rm reg (I s) for s 2,3 , where I (s) is the s th symbolic power of I . As a consequence, we prove the following bounds begin align rm reg I s le rm reg I 2s 2, text for s 2,3, rm reg I (s) le rm reg I 2s 2, text for s 2,3,4. end align


High Dimensional Stock Portfolio Trading with Deep Reinforcement Learning. This paper proposes a Deep Reinforcement Learning algorithm for financial portfolio trading based on Deep Q learning. The algorithm is capable of trading high dimensional portfolios from cross sectional datasets of any size which may include data gaps and non unique history lengths in the assets. We sequentially set up environments by sampling one asset for each environment while rewarding investments with the resulting asset's return and cash reservation with the average return of the set of assets. This enforces the agent to strategically assign capital to assets that it predicts to perform above average. We apply our methodology in an out of sample analysis to 48 US stock portfolio setups, varying in the number of stocks from ten up to 500 stocks, in the selection criteria and in the level of transaction costs. The algorithm on average outperforms all considered passive and active benchmark investment strategies by a large margin using only one hyperparameter setup for all portfolios.


mGNN Generalizing the Graph Neural Networks to the Multilayer Case. Networks are a powerful tool to model complex systems, and the definition of many Graph Neural Networks (GNN), Deep Learning algorithms that can handle networks, has opened a new way to approach many real world problems that would be hardly or even untractable. In this paper, we propose mGNN, a framework meant to generalize GNNs to the case of multi layer networks, i.e., networks that can model multiple kinds of interactions and relations between nodes. Our approach is general (i.e., not task specific) and has the advantage of extending any type of GNN without any computational overhead. We test the framework into three different tasks (node and network classification, link prediction) to validate it.


Distributed Resource Management in Downlink Cache Enabled Multi Cloud Radio Access Networks. In light of the premises of beyond fifth generation (B5G) networks, the need for better exploiting the capabilities of cloud enabled networks arises, so as to cope with the large scale interference resulting from the massive increase of data hungry systems. A compound of several clouds, jointly managing inter cloud and intra cloud interference, constitutes a practical solution to account for the requirements of B5G networks. This paper considers a multi cloud radio access network model (MC RAN), where each cloud is connected to a distinct set of base stations (BSs) via limited capacity fronthaul links. The BSs are equipped with local cache storage and baseband processing capabilities, as a means to alleviate the fronthaul congestion problem. The paper then investigates the problem of jointly assigning users to clouds and determining their beamforming vectors so as to maximize the network wide energy efficiency (EE) subject to fronthaul capacity and transmit power constraints. This paper solves such a mixed discrete continuous, non convex optimization problem using fractional programming (FP) and successive inner convex approximation (SICA) techniques to deal with the non convexity of the continuous part of the problem, and l 0 norm approximation to account for the binary association part. A highlight of the proposed algorithm is its capability of being implemented in a distributed fashion across the network's multiple clouds through a reasonable amount of information exchange. The numerical simulations illustrate the pronounced role the proposed algorithm plays in alleviating the interference of large scale MC RANs, especially in dense networks.


Medical device regulation efforts for mHealth apps An experience report of Corona Check and Corona Health. Within the healthcare environment, mobile health (mHealth) applications (apps) are more and more important. The number of new mHealth apps has risen steadily in the last years. Especially the Covid 19 pandemic has led to an enormous amount of app releases. Notably, in most countries, mHealth applications have to be already compliant with several regulatory aspects in order to be declared to be a 'medical app'. However, the latest applicable medical device regulation (MDR) does not comment in more detail on the topic of the requirements for mHealth applications. When developing a medical app, it is essential that all contributors in an interdisciplinary team especially the software engineers are aware of the specific regulatory requirements beforehand. The development process, however, should not be stalled too long due to the integration of the MDR. Therefore, a developing framework, which includes these aspects, is required, to enable a smooth development process. The paper at hand introduces the creation of such a framework on the basis of the Corona Health and Corona Check apps. The relevant regulatory guidelines are listed and summarized to a guidance for medical app developments. In particular, the important stages and faced challenges emerged during the entire development process are highlighted.


PixelSynth Generating a 3D Consistent Experience from a Single Image. Recent advancements in differentiable rendering and 3D reasoning have driven exciting results in novel view synthesis from a single image. Despite realistic results, methods are limited to relatively small view change. In order to synthesize immersive scenes, models must also be able to extrapolate. We present an approach that fuses 3D reasoning with autoregressive modeling to outpaint large view changes in a 3D consistent manner, enabling scene synthesis. We demonstrate considerable improvement in single image large angle view synthesis results compared to a variety of methods and possible variants across simulated and real datasets. In addition, we show increased 3D consistency compared to alternative accumulation methods. Project website https crockwell.github.io pixelsynth


Layer wise Adaptive Model Aggregation for Scalable Federated Learning. In Federated Learning, a common approach for aggregating local models across clients is periodic averaging of the full model parameters. It is, however, known that different layers of neural networks can have a different degree of model discrepancy across the clients. The conventional full aggregation scheme does not consider such a difference and synchronizes the whole model parameters at once, resulting in inefficient network bandwidth consumption. Aggregating the parameters that are similar across the clients does not make meaningful training progress while increasing the communication cost. We propose FedLAMA, a layer wise model aggregation scheme for scalable Federated Learning. FedLAMA adaptively adjusts the aggregation interval in a layer wise manner, jointly considering the model discrepancy and the communication cost. The layer wise aggregation method enables to finely control the aggregation interval to relax the aggregation frequency without a significant impact on the model accuracy. Our empirical study shows that FedLAMA reduces the communication cost by up to 60 for IID data and 70 for non IID data while achieving a comparable accuracy to FedAvg.


Learning Zero sum Stochastic Games with Posterior Sampling. In this paper, we propose Posterior Sampling Reinforcement Learning for Zero sum Stochastic Games (PSRL ZSG), the first online learning algorithm that achieves Bayesian regret bound of O(HS sqrt AT ) in the infinite horizon zero sum stochastic games with average reward criterion. Here H is an upper bound on the span of the bias function, S is the number of states, A is the number of joint actions and T is the horizon. We consider the online setting where the opponent can not be controlled and can take any arbitrary time adaptive history dependent strategy. This improves the best existing regret bound of O( sqrt 3 DS 2AT 2 ) by Wei et. al., 2017 under the same assumption and matches the theoretical lower bound in A and T .


On the genealogical structure of critical branching processes in a varying environment. Critical branching processes in a varying environment behave much the same as critical Galton Watson processes. In this note we like to confirm this finding with regard to the underlying genealogical structures. In particular, we consider the most recent common ancestor given survival and the corresponding reduced branching processes, in the spirit of Zubkov (1975) and Fleischmann and Siegmund Schultze (1977).


Learning to Recognize Actions on Objects in Egocentric Video with Attention Dictionaries. We present EgoACO, a deep neural architecture for video action recognition that learns to pool action context object descriptors from frame level features by leveraging the verb noun structure of action labels in egocentric video datasets. The core component of EgoACO is class activation pooling (CAP), a differentiable pooling operation that combines ideas from bilinear pooling for fine grained recognition and from feature learning for discriminative localization. CAP uses self attention with a dictionary of learnable weights to pool from the most relevant feature regions. Through CAP, EgoACO learns to decode object and scene context descriptors from video frame features. For temporal modeling in EgoACO, we design a recurrent version of class activation pooling termed Long Short Term Attention (LSTA). LSTA extends convolutional gated LSTM with built in spatial attention and a re designed output gate. Action, object and context descriptors are fused by a multi head prediction that accounts for the inter dependencies between noun verb action structured labels in egocentric video datasets. EgoACO features built in visual explanations, helping learning and interpretation. Results on the two largest egocentric action recognition datasets currently available, EPIC KITCHENS and EGTEA, show that by explicitly decoding action context object descriptors, EgoACO achieves state of the art recognition performance.


Automated Curriculum Learning for Embodied Agents A Neuroevolutionary Approach. We demonstrate how an evolutionary algorithm can be extended with a curriculum learning process that selects automatically the environmental conditions in which the evolving agents are evaluated. The environmental conditions are selected so to adjust the level of difficulty to the ability level of the current evolving agents and so to challenge the weaknesses of the evolving agents. The method does not require domain knowledge and does not introduce additional hyperparameters. The results collected on two benchmark problems, that require to solve a task in significantly varying environmental conditions, demonstrate that the method proposed outperforms conventional algorithms and generates solutions that are robust to variations


Interfacial friction dictates long range force propagation in tissues. Tissues are characterized by layers of functional units such as cells and extracellular matrix (ECM). Nevertheless, how dynamics at interlayer interfaces help transmit cellular forces in tissues remains overlooked. Here, we investigate a multi layer system where a layer of epithelial cells is seeded upon an elastic substrate in contact with a hard surface. Our experiments show that, upon a cell extrusion event in the cellular layer, long range wave propagation emerges in the substrate only when the two substrate layers were weakly attached to each other. We then derive a theoretical model which quantitatively reproduces the wave dynamics and explains how frictional sliding between substrate layers helps propagate cellular forces at a variety of scales, depending on the stiffness, thickness, and slipperiness of the substrate. These results highlight the importance of interfacial friction between layers in transmitting mechanical cues in tissues in vivo.


Non Hilbertian tangents to Hilbertian spaces. We provide examples of infinitesimally Hilbertian, rectifiable, Ahlfors regular metric measure spaces having pmGH tangents that are not infinitesimally Hilbertian.


Probability Estimation of Uncertain Process Trace Realizations. Process mining is a scientific discipline that analyzes event data, often collected in databases called event logs. Recently, uncertain event logs have become of interest, which contain non deterministic and stochastic event attributes that may represent many possible real life scenarios. In this paper, we present a method to reliably estimate the probability of each of such scenarios, allowing their analysis. Experiments show that the probabilities calculated with our method closely match the true chances of occurrence of specific outcomes, enabling more trustworthy analyses on uncertain data.


Toric orbifolds associated with partitioned weight polytopes in classical types. Given a root system Phi of type A n , B n , C n , or D n in Euclidean space E , let W be the associated Weyl group. For a point p in E not orthogonal to any of the roots in Phi , we consider the W permutohedron P W , which is the convex hull of the W orbit of p . The representation of W on the rational cohomology ring H ast(X Phi) of the toric variety X Phi associated to (the normal fan to) P W has been studied by various authors. Let s 1, ldots,s n be a complete set of simple reflections in W . For K subseteq n , let W K be the standard parabolic subgroup of W generated by s k k in K . We show that the fixed subring H ast(X Phi) W K is isomorphic to the cohomology ring of the toric variety X Phi(K) associated to a polytope obtained by intersecting P W with half spaces bounded by reflecting hyperplanes for the given generators of W K . By a result of Balibanu Crooks, the cohomology rings H ast(X Phi(K)) are isomorphic with cohomology rings of certain regular Hessenberg varieties.


Tight bounds for counting colorings and connected edge sets parameterized by cutwidth. We study the fine grained complexity of counting the number of colorings and connected spanning edge sets parameterized by the cutwidth and treewidth of the graph. Let p,q in mathbb N such that p is a prime and q geq 3 . We show If p divides q 1 , there is a (q 1) text ctw n O(1) time algorithm for counting list q colorings modulo p of n vertex graphs of cutwidth text ctw . Furthermore, no algorithm can count the number of distinct q colorings modulo p in time (q 1 varepsilon) text ctw n O(1) for some varepsilon 0 , assuming the Strong Exponential Time Hypothesis (SETH). If p does not divide q 1 , no algorithm can count the number of distinct q colorings modulo p in time (q varepsilon) text ctw n O(1) for some varepsilon 0 , assuming SETH. The lower bounds are in stark contrast with the existing 2 text ctw n O(1) time algorithm to compute the chromatic number of a graph by Jansen and Nederlof Theor. Comput. Sci.'18 . Furthermore, by building upon the above lower bounds, we obtain the following lower bound for counting connected spanning edge sets there is no varepsilon 0 for which there is an algorithm that, given a graph G and a cutwidth ordering of cutwidth text ctw , counts the number of spanning connected edge sets of G modulo p in time (p varepsilon) text ctw n O(1) , assuming SETH. We also give an algorithm with matching running time for this problem. Before our work, even for the treewidth parameterization, the best conditional lower bound by Dell et al. ACM Trans. Algorithms'14 only excluded 2 o( text tw ) n O(1) time algorithms for this problem. Both our algorithms and lower bounds employ use of the matrix rank method.


Proceedings of the 9th International Workshop on Verification and Program Transformation. The previous VPT 2020 workshop was organized in honour of Professor Alberto Pettorossi on the occasion of his academic retirement from Universit a di Roma Tor Vergata. Due to the pandemic the VPT 2020 meeting was cancelled but its proceeding have already appeared in the EPTCS 320 volume. The joint VPT 20 21 event has subsumed the original programme of VPT 2020 and provided an opportunity to meet and celebrate the achievements of Professor Alberto Pettorossi its programme was further expanded with the newly submitted presentations for VPT 2021. The aim of the VPT workshop series is to provide a forum where people from the areas of program transformation and program verification can fruitfully exchange ideas and gain a deeper understanding of the interactions between those two fields.


SnapCheck Automated Testing for Snap Programs. Programming environments such as Snap, Scratch, and Processing engage learners by allowing them to create programming artifacts such as apps and games, with visual and interactive output. Learning programming with such a media focused context has been shown to increase retention and success rate. However, assessing these visual, interactive projects requires time and laborious manual effort, and it is therefore difficult to offer automated or real time feedback to students as they work. In this paper, we introduce SnapCheck, a dynamic testing framework for Snap that enables instructors to author test cases with Condition Action templates. The goal of SnapCheck is to allow instructors or researchers to author property based test cases that can automatically assess students' interactive programs with high accuracy. Our evaluation of SnapCheck on 162 code snapshots from a Pong game assignment in an introductory programming course shows that our automated testing framework achieves at least 98 accuracy over all rubric items, showing potentials to use SnapCheck for auto grading and providing formative feedback to students.


Resource allocation problems with expensive function evaluations. The resource allocation problem is among the classical problems in operations research, and has been studied extensively for decades. However, current solution approaches are not able to efficiently handle problems with expensive function evaluations, which can occur in a variety of applications. We study the integer resource allocation problem with expensive function evaluations, for both convex and non convex separable cost functions. We present several solution methods, both heuristics and exact methods, that aim to limit the number of function evaluations. The methods are compared in numerical experiments using both randomly generated instances and instances from two resource allocation problems occurring in radiation therapy planning. The best performing method depends on the problem type, and savings in number of function evaluations can be substantial.


A Framework for Verification of Wasserstein Adversarial Robustness. Machine learning image classifiers are susceptible to adversarial and corruption perturbations. Adding imperceptible noise to images can lead to severe misclassifications of the machine learning model. Using L p norms for measuring the size of the noise fails to capture human similarity perception, which is why optimal transport based distance measures like the Wasserstein metric are increasingly being used in the field of adversarial robustness. Verifying the robustness of classifiers using the Wasserstein metric can be achieved by proving the absence of adversarial examples (certification) or proving their presence (attack). In this work we present a framework based on the work by Levine and Feizi, which allows us to transfer existing certification methods for convex polytopes or L 1 balls to the Wasserstein threat model. The resulting certification can be complete or incomplete, depending on whether convex polytopes or L 1 balls were chosen. Additionally, we present a new Wasserstein adversarial attack that is projected gradient descent based and which has a significantly reduced computational burden compared to existing attack approaches.


Ranking by Momentum based on Pareto ordering of entities. Given a set of changing entities, which ones are the most uptrending over some time T? Which entities are standing out as the biggest movers? To answer this question we define the concept of momentum. Two parameters absolute gain and relative gain over time T play the key role in defining momentum. Neither alone is sufficient since they are each biased towards a subset of entities. Absolute gain favors large entities, while relative gain favors small ones. To accommodate both absolute and relative gain in an unbiased way, we define Pareto ordering between entities. For entity E to dominate another entity F in Pareto ordering, E's absolute and relative gains over time T must be higher than F's absolute and relative gains respectively. Momentum leaders are defined as maximal elements of this partial order the Pareto frontier. We show how to compute momentum leaders and propose linear ordering among them to help rank entities with the most momentum on the top. Additionally, we show that when vectors follow power law, the cardinality of the set of Momentum leaders (Pareto frontier) is of the order of square root of the logarithm of the number of entities, thus it is very small.


Who's Afraid of Thomas Bayes?. In many cases, neural networks perform well on test data, but tend to overestimate their confidence on out of distribution data. This has led to adoption of Bayesian neural networks, which better capture uncertainty and therefore more accurately reflect the model's confidence. For machine learning security researchers, this raises the natural question of how making a model Bayesian affects the security of the model. In this work, we explore the interplay between Bayesianism and two measures of security model privacy and adversarial robustness. We demonstrate that Bayesian neural networks are more vulnerable to membership inference attacks in general, but are at least as robust as their non Bayesian counterparts to adversarial examples.


Cerebro Static Subsuming Mutant Selection. Mutation testing research has indicated that a major part of its application cost is due to the large number of low utility mutants that it introduces. Although previous research has identified this issue, no previous study has proposed any effective solution to the problem. Thus, it remains unclear how to mutate and test a given piece of code in a best effort way, i.e., achieving a good trade off between invested effort and test effectiveness. To achieve this, we propose Cerebro, a machine learning approach that statically selects subsuming mutants, i.e., the set of mutants that resides on the top of the subsumption hierarchy, based on the mutants' surrounding code context. We evaluate Cerebro using 48 and 10 programs written in C and Java, respectively, and demonstrate that it preserves the mutation testing benefits while limiting application cost, i.e., reduces all cost application factors such as equivalent mutants, mutant executions, and the mutants requiring analysis. We demonstrate that Cerebro has strong inter project prediction ability, which is significantly higher than two baseline methods, i.e., supervised learning on features proposed by state of the art, and random mutant selection. More importantly, our results show that Cerebro's selected mutants lead to strong tests that are respectively capable of killing 2 times higher than the number of subsuming mutants killed by the baselines when selecting the same number of mutants. At the same time, Cerebro reduces the cost related factors, as it selects, on average, 68 fewer equivalent mutants, while requiring 90 fewer test executions than the baselines.


Optimal Control of the Kirchhoff Equation. We consider an optimal control problem for the steady state Kirchhoff equation, a prototype for nonlocal partial differential equations, different from fractional powers of closed operators. Existence and uniqueness of solutions of the state equation, existence of global optimal solutions, differentiability of the control to state map and first order necessary optimality conditions are established. The aforementioned results require the controls to be functions in H 1 and subject to pointwise upper and lower bounds. In order to obtain the Newton differentiability of the optimality conditions, we employ a Moreau Yosida type penalty approach to treat the control constraints and study its convergence. The first order optimality conditions of the regularized problems are shown to be Newton diffentiable, and a generalized Newton method is detailed. A discretization of the optimal control problem by piecewise linear finite elements is proposed and numerical results are presented.


Uniqueness typing for intersection types. Working in a variant of the intersection type assignment system of Coppo, Dezani Ciancaglini and Veneri 1981 , we prove several facts about sets of terms having a given intersection type. Our main result is that every strongly normalizing term M admits a uniqueness typing , which is a pair ( Gamma,A) such that 1) Gamma vdash M A 2) Gamma vdash N A Longrightarrow M beta eta N We also discuss several presentations of intersection type algebras, and the corresponding choices of type assignment rules.


Emotion aware Chat Machine Automatic Emotional Response Generation for Human like Emotional Interaction. The consistency of a response to a given post at semantic level and emotional level is essential for a dialogue system to deliver human like interactions. However, this challenge is not well addressed in the literature, since most of the approaches neglect the emotional information conveyed by a post while generating responses. This article addresses this problem by proposing a unifed end to end neural architecture, which is capable of simultaneously encoding the semantics and the emotions in a post for generating more intelligent responses with appropriately expressed emotions. Extensive experiments on real world data demonstrate that the proposed method outperforms the state of the art methods in terms of both content coherence and emotion appropriateness.


Around Hilbert's theorem the center of a circle is not constructible by straightedge alone. In order to state the theorem in the title formally and to review its rigorous proof, we extend and make more precise the Uspenskiy Shen Akopyan Fedorov model of Euclidean constructions with arbitrary points we also introduce formalizations for infinite configurations and for the projective plane. We exemplify the proof method by simpler and not so well known results that it is impossible to construct the unit length, or a given point, by compass and straightedge from nothing by means of classical arbitrary points. On the other hand we construct any given point by compass and straightedge from nothing by means of arbitrary points determined by horizontal segments. We quote a "proof" of Hilbert's theorem from the literature and explain why it is problematic. We rigorously prove Hilbert's theorem and present three variants of it, the last one for the projective plane.


Restore from Restored Single image Inpainting. Recent image inpainting methods have shown promising results due to the power of deep learning, which can explore external information available from the large training dataset. However, many state of the art inpainting networks are still limited in exploiting internal information available in the given input image at test time. To mitigate this problem, we present a novel and efficient self supervised fine tuning algorithm that can adapt the parameters of fully pre trained inpainting networks without using ground truth target images. We update the parameters of the pre trained state of the art inpainting networks by utilizing existing self similar patches (i.e., self exemplars) within the given input image without changing the network architecture and improve the inpainting quality by a large margin. Qualitative and quantitative experimental results demonstrate the superiority of the proposed algorithm, and we achieve state of the art inpainting results on publicly available benchmark datasets.


Scheduling with Machine Conflicts. We study the scheduling problem of makespan minimization while taking machine conflicts into account. Machine conflicts arise in various settings, e.g., shared resources for pre and post processing of tasks or spatial restrictions. In this context, each job has a blocking time before and after its processing time, i.e., three parameters. We seek for conflict free schedules in which the blocking times of no two jobs intersect on conflicting machines. Given a set of jobs, a set of machines, and a graph representing machine conflicts, the problem SchedulingWithMachineConflicts (SMC), asks for a conflict free schedule of minimum makespan. We show that, unless textrm P textrm NP , SMC on m machines does not allow for a mathcal O (m 1 varepsilon ) approximation algorithm for any varepsilon 0 , even in the case of identical jobs and every choice of fixed positive parameters, including the unit case. Complementary, we provide approximation algorithms when a suitable collection of independent sets is given. Finally, we present polynomial time algorithms to solve the problem for the case of unit jobs on special graph classes. Most prominently, we solve it for bipartite graphs by using structural insights for conflict graphs of star forests.


New apparatus design for high precision measurement ofG with atom interferometry. We propose a new scheme for an improved determination of the Newtonian gravitational constant G and evaluate it by numerical simulations. Cold atoms in free fall are probed by atom interferometry measurements to characterize the gravitational field generated by external source masses. Two source mass configurations having different geometry and using different materials are compared to identify an optimized experimental setup for the G measurement. The effects of the magnetic fields used to manipulate the atoms and to control the interferometer phase are also characterized.


Add drop multiplexers for terahertz communications using two wire waveguide based plasmonic circuits. Terahertz (THz) band is considered as the next frontier in wireless communications. The emerging THz multiplexing techniques are expected to dramatically increase the information capacity of THz communications far beyond a single channel limit. In this work, we explore the THz frequency division multiplexing modality enabled by novel add drop multiplexer (ADM) design. Based on modular two wire plasmonic waveguides fabricated using additive manufacturing and metallization techniques, we demonstrate four port THz ADMs containing grating loaded side couplers for operation at 140 GHz carrier frequency. Particular attention is payed to the design of plasmonic waveguide Bragg gratings and directional couplers capable of splitting broadband THz light in spectral and spatial domains, respectively. Finally, we demonstrate multiplexing and demultiplexing of THz signals with bit rates up to 6 Gbps using the developed ADMs. We believe that proposed plasmonic circuits hold strong potential to provide robust integrated solutions for analogue signal processing in the upcoming THz communications.


Adaptive finite element method for an elliptic optimal control problem with integral state constraints. In this article, we develop a posteriori error analysis of a nonconforming finite element method for a linear quadratic elliptic distributed optimal control problem with two different set of constraints, namely (i) integral state constraint and integral control constraint (ii) integral state constraint and pointwise control constraints. In the analysis, we have taken the approach of reducing the state control constrained minimization problem into a state minimization problem obtained by eliminating the control variable. The reliability and efficiency of a posteriori error estimator are discussed. Numerical results are reported to illustrate the behavior of the error estimator.


Single Run Action Detector over Video Stream A Privacy Preserving Approach. This paper takes initial strides at designing and evaluating a vision based system for privacy ensured activity monitoring. The proposed technology utilizing Artificial Intelligence (AI) empowered proactive systems offering continuous monitoring, behavioral analysis, and modeling of human activities. To this end, this paper presents Single Run Action Detector (S RAD) which is a real time privacy preserving action detector that performs end to end action localization and classification. It is based on Faster RCNN combined with temporal shift modeling and segment based sampling to capture the human actions. Results on UCF Sports and UR Fall dataset present comparable accuracy to State of the Art approaches with significantly lower model size and computation demand and the ability for real time execution on edge embedded device (e.g. Nvidia Jetson Xavier).


Augmenting Modelers with Semantic Autocompletion of Processes. Business process modelers need to have expertise and knowledge of the domain that may not always be available to them. Therefore, they may benefit from tools that mine collections of existing processes and recommend element(s) to be added to a new process that they are constructing. In this paper, we present a method for process autocompletion at design time, that is based on the semantic similarity of sub processes. By converting sub processes to textual paragraphs and encoding them as numerical vectors, we can find semantically similar ones, and thereafter recommend the next element. To achieve this, we leverage a state of the art technique for embedding natural language as vectors. We evaluate our approach on open source and proprietary datasets and show that our technique is accurate for processes in various domains.


TNNT The Named Entity Recognition Toolkit. Extraction of categorised named entities from text is a complex task given the availability of a variety of Named Entity Recognition (NER) models and the unstructured information encoded in different source document formats. Processing the documents to extract text, identifying suitable NER models for a task, and obtaining statistical information is important in data analysis to make informed decisions. This paper presents TNNT, a toolkit that automates the extraction of categorised named entities from unstructured information encoded in source documents, using diverse state of the art Natural Language Processing (NLP) tools and NER models. TNNT integrates 21 different NER models as part of a Knowledge Graph Construction Pipeline (KGCP) that takes a document set as input and processes it based on the defined settings, applying the selected blocks of NER models to output the results. The toolkit generates all results with an integrated summary of the extracted entities, enabling enhanced data analysis to support the KGCP, and also, to aid further NLP tasks.


Assessing the Lockdown Effects on Air Quality during COVID 19 Era. In this work we investigate the short term variations in air quality emissions, attributed to the prevention measures, applied in different cities, to mitigate the COVID 19 spread. In particular, we emphasize on the concentration effects regarding specific pollutant gases, such as carbon monoxide (CO), ozone (O3), nitrogen dioxide (NO2) and sulphur dioxide (SO2). The assessment of the impact of lockdown on air quality focused on four European Cities (Athens, Gladsaxe, Lodz and Rome). Available data on pollutant factors were obtained using global satellite observations. The level of the employed prevention measures is employed using the Oxford COVID 19 Government Response Tracker. The second part of the analysis employed a variety of machine learning tools, utilized for estimating the concentration of each pollutant, two days ahead. The results showed that a weak to moderate correlation exists between the corresponding measures and the pollutant factors and that it is possible to create models which can predict the behaviour of the pollutant gases under daily human activities.


MReD A Meta Review Dataset for Structure Controllable Text Generation. When directly using existing text generation datasets for controllable generation, we are facing the problem of not having the domain knowledge and thus the aspects that could be controlled are limited. A typical example is when using CNN Daily Mail dataset for controllable text summarization, there is no guided information on the emphasis of summary sentences. A more useful text generator should leverage both the input text and the control signal to guide the generation, which can only be built with a deep understanding of the domain knowledge. Motivated by this vision, our paper introduces a new text generation dataset, named MReD. Our new dataset consists of 7,089 meta reviews and all its 45k meta review sentences are manually annotated with one of the 9 carefully defined categories, including abstract, strength, decision, etc. We present experimental results on start of the art summarization models, and propose methods for structure controlled generation with both extractive and abstractive models using our annotated data. By exploring various settings and analyzing the model behavior with respect to the control signal, we demonstrate the challenges of our proposed task and the values of our dataset MReD. Meanwhile, MReD also allows us to have a better understanding of the meta review domain.


An infinite class of Neumaier graphs and non existence results. A Neumaier graph is a non complete edge regular graph containing a regular clique. A Neumaier graph that is not strongly regular is called a strictly Neumaier graph. In this work we present a new construction of strictly Neumaier graphs, and using Jacobi sums, we show that our construction produces infinitely many instances. Moreover, we prove some necessary conditions for the existence of (strictly) Neumaier graphs that allow us to show that several parameter sets are not admissible.


Outage Probability of Intelligent Reflecting Surfaces Assisted Full Duplex Two way Communications. In this letter, we study the outage probability of intelligent reflecting surface (IRS) assisted full duplex two way communication systems, which characterizes the performance of overcoming the transmitted data loss caused by long deep fades. To this end, we first derive the probability distribution of the cascaded end to end equivalent channel with an arbitrarily given IRS beamformer. Our analysis shows that deriving such probability distribution in the considered case is more challenging than the case with the phase matched IRS beamformer. Then, with the derived probability distribution of the equivalent channel, we obtain the closed form expression of the outage probability performance. It theoretically shows that the reflecting element number has a conspicuous effect on the improvement of the system reliability. Extensive numerical results verify the correctness of the derived results and confirm the superiority of the considered IRS assisted two way communication system comparing to the one way counterpart.


A Typology of Data Anomalies. Anomalies are cases that are in some way unusual and do not appear to fit the general patterns present in the dataset. Several conceptualizations exist to distinguish between different types of anomalies. However, these are either too specific to be generally applicable or so abstract that they neither provide concrete insight into the nature of anomaly types nor facilitate the functional evaluation of anomaly detection algorithms. With the recent criticism on 'black box' algorithms and analytics it has become clear that this is an undesirable situation. This paper therefore introduces a general typology of anomalies that offers a clear and tangible definition of the different types of anomalies in datasets. The typology also facilitates the evaluation of the functional capabilities of anomaly detection algorithms and as a framework assists in analyzing the conceptual levels of data, patterns and anomalies. Finally, it serves as an analytical tool for studying anomaly types from other typologies.


Asymptotic behavior of a class of multiple time scales stochastic kinetic equations. We consider a class of stochastic kinetic equations, depending on two time scale separation parameters epsilon and delta the evolution equation contains singular terms with respect to epsilon , and is driven by a fast ergodic process which evolves at the time scale t delta 2 . We prove that when ( epsilon, delta) to (0,0) the density converges to the solution of a linear diffusion PDE. This is a mixture of diffusion approximation in the PDE sense (with respect to the parameter epsilon ) and of averaging in the probabilistic sense (with respect to the parameter delta ). The proof employs stopping times arguments and a suitable perturbed test functions approach which is adapted to consider the general regime epsilon neq delta .


Disambiguating Affective Stimulus Associations for Robot Perception and Dialogue. Effectively recognising and applying emotions to interactions is a highly desirable trait for social robots. Implicitly understanding how subjects experience different kinds of actions and objects in the world is crucial for natural HRI interactions, with the possibility to perform positive actions and avoid negative actions. In this paper, we utilize the NICO robot's appearance and capabilities to give the NICO the ability to model a coherent affective association between a perceived auditory stimulus and a temporally asynchronous emotion expression. This is done by combining evaluations of emotional valence from vision and language. NICO uses this information to make decisions about when to extend conversations in order to accrue more affective information if the representation of the association is not coherent. Our primary contribution is providing a NICO robot with the ability to learn the affective associations between a perceived auditory stimulus and an emotional expression. NICO is able to do this for both individual subjects and specific stimuli, with the aid of an emotion driven dialogue system that rectifies emotional expression incoherences. The robot is then able to use this information to determine a subject's enjoyment of perceived auditory stimuli in a real HRI scenario.


Knowledge Based Multilingual Language Model. Knowledge enriched language representation learning has shown promising performance across various knowledge intensive NLP tasks. However, existing knowledge based language models are all trained with monolingual knowledge graph data, which limits their application to more languages. In this work, we present a novel framework to pretrain knowledge based multilingual language models (KMLMs). We first generate a large amount of code switched synthetic sentences and reasoning based multilingual training data using the Wikidata knowledge graphs. Then based on the intra and inter sentence structures of the generated data, we design pretraining tasks to facilitate knowledge learning, which allows the language models to not only memorize the factual knowledge but also learn useful logical patterns. Our pretrained KMLMs demonstrate significant performance improvements on a wide range of knowledge intensive cross lingual NLP tasks, including named entity recognition, factual knowledge retrieval, relation classification, and a new task designed by us, namely, logic reasoning. Our code and pretrained language models will be made publicly available.


NPBDREG Uncertainty Assessment in Diffeomorphic Brain MRI Registration using a Non parametric Bayesian Deep Learning Based Approach. Quantification of uncertainty in deep neural networks (DNN) based image registration algorithms plays a critical role in the deployment of image registration algorithms for clinical applications such as surgical planning, intraoperative guidance, and longitudinal monitoring of disease progression or treatment efficacy as well as in research oriented processing pipelines. Currently available approaches for uncertainty estimation in DNN based image registration algorithms may result in sub optimal clinical decision making due to potentially inaccurate estimation of the uncertainty of the registration stems for the assumed parametric distribution of the registration latent space. We introduce NPBDREG, a fully non parametric Bayesian framework for uncertainty estimation in DNN based deformable image registration by combining an Adam optimizer with stochastic gradient Langevin dynamics (SGLD) to characterize the underlying posterior distribution through posterior sampling. Thus, it has the potential to provide uncertainty estimates that are highly correlated with the presence of out of distribution data. We demonstrated the added value of NPBDREG, compared to the baseline probabilistic VoxelMorph model (PrVXM), on brain MRI image registration using 390 image pairs from four publicly available databases MGH10, CMUC12, ISBR18 and LPBA40. The NPBDREG shows a better correlation of the predicted uncertainty with out of distribution data ( r 0.95 vs. r 0.5 ) as well as a 7.3 improvement in the registration accuracy (Dice score, 0.74 vs. 0.69 , p ll 0.01 ), and 18 improvement in registration smoothness (percentage of folds in the deformation field, 0.014 vs. 0.017, p ll 0.01 ). Finally, NPBDREG demonstrated a better generalization capability for data corrupted by a mixed structure noise (Dice score of 0.73 vs. 0.69 , p ll 0.01 ) compared to the baseline PrVXM approach.


Horofunction compactifications and duality. We study the global topology of the horofunction compactification of smooth manifolds with a Finsler distance. The main goal is to show, for certain classes of these spaces, that the horofunction compactification is naturally homeomorphic to the closed unit ball of the dual norm of the norm in the tangent space (at the base point) that generates the Finsler distance. We construct explicit homeomorphisms for a variety of spaces in three settings bounded convex domains in mathbb C n with the Kobayashi distance, Hilbert geometries, and finite dimensional normed spaces. For the spaces under consideration, the horofunction boundary has an intrinsic partition into so called parts. The natural connection with the dual norm arises through the fact that the homeomorphism maps each part in the horofunction boundary onto the relative interior of a boundary face of the dual unit ball. For normed spaces the connection between the global topology of the horofunction boundary and the dual norm was suggested by Kapovich and Leeb. We confirm this connection for Euclidean Jordan algebras equipped with the spectral norm.


Almost sure diffusion approximation in averaging via rough paths theory. The paper deals with the fast slow motions setups in the continuous time frac dX ve(t) dt frac 1 ve sig(X ve(t)) xi(t ve 2) b(X ve(t)), , t in 0,T and the discrete time X N((n 1) N) X N(n N) N 1 2 sig(X N(n N)) xi(n)) N 1 b(X N(n N)) xi(n) , n 0,1,..., TN where sig and b are smooth matrix and vector functions, respectively, xi is a centered stationary vector stochastic process and ve, 1 N are small parameters. We derive, first, estimates in the strong invariance principles for sums S N (t) N 1 2 sum 0 leq k Nt xi(k) and iterated sums bbS ij N (t) N 1 sum 0 leq k l Nt xi i(k) xi j(l) together with the corresponding results for integrals in the continuous time case which, in fact, yields almost sure invariance principles for iterated sums and integrals of any order and, moreover, implies laws of iterated logarithm for these objects. Then, relying on the rough paths theory, we obtain strong almost sure approximations of processes X ve and X N by corresponding diffusion processes Xi ve and Xi N , respectively. Previous results for the above setup dealt either with weak or moment diffusion approximations and not with almost sure approximation which is the new and natural generalization of well known works on strong invariance principles for sums of weakly dependent random variables.


One shot domain adaptation for semantic face editing of real world images using StyleALAE. Semantic face editing of real world facial images is an important application of generative models. Recently, multiple works have explored possible techniques to generate such modifications using the latent structure of pre trained GAN models. However, such approaches often require training an encoder network and that is typically a time consuming and resource intensive process. A possible alternative to such a GAN based architecture can be styleALAE, a latent space based autoencoder that can generate photo realistic images of high quality. Unfortunately, the reconstructed image in styleALAE does not preserve the identity of the input facial image. This limits the application of styleALAE for semantic face editing of images with known identities. In our work, we use a recent advancement in one shot domain adaptation to address this problem. Our work ensures that the identity of the reconstructed image is the same as the given input image. We further generate semantic modifications over the reconstructed image by using the latent space of the pre trained styleALAE model. Results show that our approach can generate semantic modifications on any real world facial image while preserving the identity.


Improved a priori error estimates for a discontinuous Galerkin pressure correction scheme for the Navier Stokes equations. The pressure correction scheme is combined with interior penalty discontinuous Galerkin method to solve the time dependent Navier Stokes equations. Optimal error estimates are derived for the velocity in the L 2 norm in time and in space. Error bounds for the discrete time derivative of the velocity and for the pressure are also established.


Sample covariance matrices and special symmetric partitions. Suppose X p is a real p times n matrix with independent entries and consider the (unscaled) sample covariance matrix S p X pX p T . The Marchenko Pastur law was discovered as the limit of the bulk distribution of the sample covariance matrix in 1967. There have been extensions of this result in several directions. In this paper, we consider an extension that handles several of the existing ones as well as generates new results. We show that under suitable assumptions on the entries of X p , the limiting spectral distribution exists in probability or almost surely. The moments are described by a set of partitions that are beyond pair partitions and non crossing partitions and are also related to special symmetric partitions, which are known to appear in the limiting spectral distribution of Wigner type matrices. Similar results hold for other patterned matrices such as reverse circulant, circulant, Toeplitz, and Hankel matrices.


The determination of a doubly resolving set with the minimum size for C n Box P k and some minimal resolving parameters for Double Graph of C n Box P k . The applications of doubly resolving sets and its related parameters in graph theory have played a special role in the study of other sciences and note that the determination of a doubly resolving set with the minimum size is very useful. In this work, we will consider the computational study of doubly resolving sets of the cartesian product C n Box P k and its double graph of the cartesian product C n Box P k , will be denoted by D C n Box P k . Indeed, we will show that if n is an even or odd integer, then the minimum size of a doubly resolving set in C n Box P k is 3 , and more we compute some minimal resolving parameters for the double graph of the cartesian product C n Box P k . In particular, we will show that if n is an even or odd integer, then the minimum size of a doubly resolving set in D C n Box P k is 4 .


Convolutional Gated MLP Combining Convolutions gMLP. To the best of our knowledge, this is the first paper to introduce Convolutions to Gated MultiLayer Perceptron and contributes an implementation of this novel Deep Learning architecture. Google Brain introduced the gMLP in May 2021. Microsoft introduced Convolutions in Vision Transformer in Mar 2021. Inspired by both gMLP and CvT, we introduce convolutional layers in gMLP. CvT combined the power of Convolutions and Attention. Our implementation combines the best of Convolutional learning along with spatial gated MLP. Further, the paper visualizes how CgMLP learns. Visualizations show how CgMLP learns from features such as outline of a car. While Attention was the basis of much of recent progress in Deep Learning, gMLP proposed an approach that doesn't use Attention computation. In Transformer based approaches, a whole lot of Attention matrixes need to be learnt using vast amount of training data. In gMLP, the fine tunning for new tasks can be challenging by transfer learning with smaller datasets. We implement CgMLP and compares it with gMLP on CIFAR dataset. Experimental results explore the power of generaliza tion of CgMLP, while gMLP tend to drastically overfit the training data. To summarize, the paper contributes a novel Deep Learning architecture and demonstrates the learning mechanism of CgMLP through visualizations, for the first time in literature.


A low rank solution method for Riccati equations with indefinite quadratic terms. Algebraic Riccati equations with indefinite quadratic terms play an important role in applications related to robust controller design. While there are many established approaches to solve these in case of small scale dense coefficients, there is no approach available to compute solutions in the large scale sparse setting. In this paper, we develop an iterative method to compute low rank approximations of stabilizing solutions of large scale sparse continuous time algebraic Riccati equations with indefinite quadratic terms. We test the developed approach for dense examples in comparison to other established matrix equation solvers, and investigate the applicability and performance in large scale sparse examples.


FedProto Federated Prototype Learning across Heterogeneous Clients. Heterogeneity across clients in federated learning (FL) usually hinders the optimization convergence and generalization performance when the aggregation of clients' knowledge occurs in the gradient space. For example, clients may differ in terms of data distribution, network latency, input output space, and or model architecture, which can easily lead to the misalignment of their local gradients. To improve the tolerance to heterogeneity, we propose a novel federated prototype learning (FedProto) framework in which the clients and server communicate the abstract class prototypes instead of the gradients. FedProto aggregates the local prototypes collected from different clients, and then sends the global prototypes back to all clients to regularize the training of local models. The training on each client aims to minimize the classification error on the local data while keeping the resulting local prototypes sufficiently close to the corresponding global ones. Moreover, we provide a theoretical analysis to the convergence rate of FedProto under non convex objectives. In experiments, we propose a benchmark setting tailored for heterogeneous FL, with FedProto outperforming several recent FL approaches on multiple datasets.


Controllability near a homoclinic bifurcation. Controllability properties are studied for control affine systems depending on a parameter and with constrained control values. The uncontrolled systems in dimension two and three are subject to a homoclinic bifurcation. This generates two families of control sets depending on a parameter in the involved vector fields and the size of the control range. A new parameter given by a split function for the homoclinic bifurcation determines the behavior of these control sets. It is also shown that there are parameter regions where the uncontrolled equation has no periodic orbits, while the controlled systems have periodic solutions arbitrarily close to the homoclinic orbit


Non cyclic Torsion Over Imaginary Quadratic Fields of Class Number 1. Let K be a non cylotomic imaginary quadratic field of class number 1 and E K is an elliptic curve with E(K) 2 simeq mathbb Z 2 oplus mathbb Z 2. In this article, we determine the torsion groups that can arise as E(L) text tor where L is a quadratic extension of K.


A Survey on Methods and Metrics for the Assessment of Explainability under the Proposed AI Act. This study discusses the interplay between metrics used to measure the explainability of the AI systems and the proposed EU Artificial Intelligence Act. A standardisation process is ongoing several entities (e.g. ISO) and scholars are discussing how to design systems that are compliant with the forthcoming Act and explainability metrics play a significant role. This study identifies the requirements that such a metric should possess to ease compliance with the AI Act. It does so according to an interdisciplinary approach, i.e. by departing from the philosophical concept of explainability and discussing some metrics proposed by scholars and standardisation entities through the lenses of the explainability obligations set by the proposed AI Act. Our analysis proposes that metrics to measure the kind of explainability endorsed by the proposed AI Act shall be risk focused, model agnostic, goal aware, intelligible accessible. This is why we discuss the extent to which these requirements are met by the metrics currently under discussion.


On Bayesian data assimilation for PDEs with ill posed forward problems. We study Bayesian data assimilation (filtering) for time evolution PDEs, for which the underlying forward problem may be very unstable or ill posed. Such PDEs, which include the Navier Stokes equations of fluid dynamics, are characterized by a high sensitivity of solutions to perturbations of the initial data, a lack of rigorous global well posedness results as well as possible non convergence of numerical approximations. Under very mild and readily verifiable general hypotheses on the forward solution operator of such PDEs, we prove that the posterior measure expressing the solution of the Bayesian filtering problem is stable with respect to perturbations of the noisy measurements, and we provide quantitative estimates on the convergence of approximate Bayesian filtering distributions computed from numerical approximations. For the Navier Stokes equations, our results imply uniform stability of the filtering problem even at arbitrarily small viscosity, when the underlying forward problem may become ill posed, as well as the compactness of numerical approximants in a suitable metric on time parametrized probability measures.


Strongly resonant RABBITT on lithium. The process of reconstruction of attosecond beating by interference of two photon transitions (RABBITT) can become resonant with a discrete atomic level either in the intermediate or the final continuous states. Experimental observations of the former Phys. Rev. Lett. 104, 103003 (2010) or latter Nat. Commun. 7, 10566 (2016) cases revealed modification of only those parts of the photoelectron spectrum that overlapped directly with the resonance. In the lithium atom and other members of the alkali metal family, the valence shell ns to np transition to the intermediate RABBITT state affects the whole photoelectron spectrum in the final state. The strong additional resonant channel modifies entirely the ionization dynamics and opens direct access to the resonant phase of the two photon transitions which is common for various single and multiple electron ionization processes. Elucidation of this phase has wider implications for strongly resonant laser matter interaction.


Deep Variational Models for Collaborative Filtering based Recommender Systems. Deep learning provides accurate collaborative filtering models to improve recommender system results. Deep matrix factorization and their related collaborative neural networks are the state of art in the field nevertheless, both models lack the necessary stochasticity to create the robust, continuous, and structured latent spaces that variational autoencoders exhibit. On the other hand, data augmentation through variational autoencoder does not provide accurate results in the collaborative filtering field due to the high sparsity of recommender systems. Our proposed models apply the variational concept to inject stochasticity in the latent space of the deep architecture, introducing the variational technique in the neural collaborative filtering field. This method does not depend on the particular model used to generate the latent representation. In this way, this approach can be applied as a plugin to any current and future specific models. The proposed models have been tested using four representative open datasets, three different quality measures, and state of art baselines. The results show the superiority of the proposed approach in scenarios where the variational enrichment exceeds the injected noise effect. Additionally, a framework is provided to enable the reproducibility of the conducted experiments.


VSAC Efficient and Accurate Estimator for H and F. We present VSAC, a RANSAC type robust estimator with a number of novelties. It benefits from the introduction of the concept of independent inliers that improves significantly the efficacy of the dominant plane handling and, also, allows near error free rejection of incorrect models, without false positives. The local optimization process and its application is improved so that it is run on average only once. Further technical improvements include adaptive sequential hypothesis verification and efficient model estimation via Gaussian elimination. Experiments on four standard datasets show that VSAC is significantly faster than all its predecessors and runs on average in 1 2 ms, on a CPU. It is two orders of magnitude faster and yet as precise as MAGSAC , the currently most accurate estimator of two view geometry. In the repeated runs on EVD, HPatches, PhotoTourism, and Kusvod2 datasets, it never failed.


Model free Data Driven Inference. We present a model free data driven inference method that enables inferences on system outcomes to be derived directly from empirical data without the need for intervening modeling of any type, be it modeling of a material law or modeling of a prior distribution of material states. We specifically consider physical systems with states characterized by points in a phase space determined by the governing field equations. We assume that the system is characterized by two likelihood measures one mu D measuring the likelihood of observing a material state in phase space and another mu E measuring the likelihood of states satisfying the field equations, possibly under random actuation. We introduce a notion of intersection between measures which can be interpreted to quantify the likelihood of system outcomes. We provide conditions under which the intersection can be characterized as the athermal limit mu infty of entropic regularizations mu beta , or thermalizations, of the product measure mu mu D times mu E as beta to infty . We also supply conditions under which mu infty can be obtained as the athermal limit of carefully thermalized ( mu h, beta h ) sequences of empirical data sets ( mu h) approximating weakly an unknown likelihood function mu . In particular, we find that the cooling sequence beta h to infty must be slow enough, corresponding to quenching, in order for the proper limit mu infty to be delivered. Finally, we derive explicit analytic expressions for expectations mathbb E f of outcomes f that are explicit in the data, thus demonstrating the feasibility of the model free data driven paradigm as regards making convergent inferences directly from the data without recourse to intermediate modeling steps.


Symmetry results for Serrin type problems in doubly connected domains. In this work, we employ the technique developed in arXiv 2109.11255 to prove rotational symmetry for a class of Serrin type problems for the standard laplacian. We also discuss in some length how our strategy compares with the classical moving plane method.


Extreme exoworlds and the extremophile paradox. Extremophiles have gained prominence by providing an experimental approach to astrobiology. Extremophiles gain equal value by being part of a framework for high level characterisation of the evolutionary mechanisms that must necessarily restrict or promote their emergence and presence on solar system bodies. Thus, extremophiles exist in extreme environments, and therein lies the paradox extremophiles can only live in extreme environments but yet are not able to originate in such environments. Therefore, even though the range of extremophile capabilities in extreme environments is wider than that in mesophiles, the range of their emergence possibilities is still equally restricted. Therefore, even if one locates an extreme exoworld where terrestrial extremophiles could live here and now, it can be predicted that no extremophile analogues are present anyway. Furthermore, it is possible for a world to be uninhabited, yet be habitable, and therein arises the extreme environment paradox an extreme environment can sustain chemical evolution as well as arriving non native life, yet native life cannot be built up in that very environment. Thus, life may exist on an extraterrestrial extreme world (if imported there), and chemical evolution may be present on that world. However, it can be predicted that there is no native life anyway. This situation can be predicted to function as a chemosignature and eventually as a biosignature. However, the fact that a non native extremopile in principle can exist in extreme environments may demonstrate that the intermediate step between chemical evolution and extremophiles can still occur in the form of a statistical deviation.


How Hateful are Movies? A Study and Prediction on Movie Subtitles. In this research, we investigate techniques to detect hate speech in movies. We introduce a new dataset collected from the subtitles of six movies, where each utterance is annotated either as hate, offensive or normal. We apply transfer learning techniques of domain adaptation and fine tuning on existing social media datasets, namely from Twitter and Fox News. We evaluate different representations, i.e., Bag of Words (BoW), Bi directional Long short term memory (Bi LSTM), and Bidirectional Encoder Representations from Transformers (BERT) on 11k movie subtitles. The BERT model obtained the best macro averaged F1 score of 77 . Hence, we show that transfer learning from the social media domain is efficacious in classifying hate and offensive speech in movies through subtitles.


End to End Training of Multi Document Reader and Retriever for Open Domain Question Answering. We present an end to end differentiable training method for retrieval augmented open domain question answering systems that combine information from multiple retrieved documents when generating answers. We model retrieval decisions as latent variables over sets of relevant documents. Since marginalizing over sets of retrieved documents is computationally hard, we approximate this using an expectation maximization algorithm. We iteratively estimate the value of our latent variable (the set of relevant documents for a given question) and then use this estimate to update the retriever and reader parameters. We hypothesize that such end to end training allows training signals to flow to the reader and then to the retriever better than staged wise training. This results in a retriever that is able to select more relevant documents for a question and a reader that is trained on more accurate documents to generate an answer. Experiments on three benchmark datasets demonstrate that our proposed method outperforms all existing approaches of comparable size by 2 3 absolute exact match points, achieving new state of the art results. Our results also demonstrate the feasibility of learning to retrieve to improve answer generation without explicit supervision of retrieval decisions.


Recognizing and prevention of probable regime shift in density regulated and Allee type stochastic harvesting model with application to herring conservation. An ecological system with multiple stable equilibria is prone to undergo catastrophic change or regime shift from one steady state to another. It should be noted that, if one of the steady states is an extinction state, the catastrophic change may lead to extinction. A suitable manual measure may control the prevention of catastrophic changes of different species from one equilibrium to another. We consider two stochastic models with linear and nonlinear harvesting terms. We inspect either density regulation or Allee type density regulated models Saha et al., Ecological Modelling, 2013 , which have substantial applications in the herring fish population's viability study. Both the deterministic models we consider here contain bi stability under certain restrictions, and in that case, one of the stable states is the extinction state. We assume that the dynamical system under consideration is closed, i.e., immigration and emigration are absent. The demographic noise is introduced in the system by substituting an ordinary differential equation with a stochastic differential equation model, where the birth and death rates of the deterministic process are used to obtain the instantaneous mean and variance in the stochastic differential equation. Our study reveals that, the catastrophic changes can be avoided manually by a suitable choice of handling time that will eventually help to prevent the sudden extinction of the harvested population. The entire study is illustrated through the herring population size data obtained from the Global Population Dynamics Database (GPDD) and simulation experiment.


A Design Space Study for LISTA and Beyond. In recent years, great success has been witnessed in building problem specific deep networks from unrolling iterative algorithms, for solving inverse problems and beyond. Unrolling is believed to incorporate the model based prior with the learning capacity of deep learning. This paper revisits the role of unrolling as a design approach for deep networks to what extent its resulting special architecture is superior, and can we find better? Using LISTA for sparse recovery as a representative example, we conduct the first thorough design space study for the unrolled models. Among all possible variations, we focus on extensively varying the connectivity patterns and neuron types, leading to a gigantic design space arising from LISTA. To efficiently explore this space and identify top performers, we leverage the emerging tool of neural architecture search (NAS). We carefully examine the searched top architectures in a number of settings, and are able to discover networks that are consistently better than LISTA. We further present more visualization and analysis to "open the black box", and find that the searched top architectures demonstrate highly consistent and potentially transferable patterns. We hope our study to spark more reflections and explorations on how to better mingle model based optimization prior and data driven learning.


Practical and Fast Momentum Based Power Methods. The power method is a classical algorithm with broad applications in machine learning tasks, including streaming PCA, spectral clustering, and low rank matrix approximation. The distilled purpose of the vanilla power method is to determine the largest eigenvalue (in absolute modulus) and its eigenvector of a matrix. A momentum based scheme can be used to accelerate the power method, but achieving an optimal convergence rate with existing algorithms critically relies on additional spectral information that is unavailable at run time, and sub optimal initializations can result in divergence. In this paper, we provide a pair of novel momentum based power methods, which we call the delayed momentum power method (DMPower) and a streaming variant, the delayed momentum streaming method (DMStream). Our methods leverage inexact deflation and are capable of achieving near optimal convergence with far less restrictive hyperparameter requirements. We provide convergence analyses for both algorithms through the lens of perturbation theory. Further, we experimentally demonstrate that DMPower routinely outperforms the vanilla power method and that both algorithms match the convergence speed of an oracle running existing accelerated methods with perfect spectral knowledge.


The ridge method for tame min max problems. We study the ridge method for min max problems, and investigate its convergence without any convexity, differentiability or qualification assumption. The central issue is to determine whether the "parametric optimality formula" provides a conservative field, a notion of generalized derivative well suited for optimization. The answer to this question is positive in a semi algebraic, and more generally definable, context. The proof involves a new characterization of definable conservative fields which is of independent interest. As a consequence, the ridge method applied to definable objectives is proved to have a minimizing behavior and to converge to a set of equilibria which satisfy an optimality condition. Definability is key to our proof we show that for a more general class of nonsmooth functions, conservativity of the parametric optimality formula may fail, resulting in an absurd behavior of the ridge method.


A Subatomic Proof System for Decision Trees. We design a proof system for propositional classical logic that integrates two languages for Boolean functions standard conjunction disjunction negation and binary decision trees. We give two reasons to do so. The first is proof theoretical naturalness the system consists of all and only the inference rules generated by the single, simple, linear shape of the recently introduced subatomic logic. Thanks to this regularity, cuts are eliminated via a natural construction. The second reason is that the system generates efficient proofs. Indeed, we show that a certain class of tautologies due to Statman, which cannot have better than exponential cut free proofs in the sequent calculus, have polynomial cut free proofs in our system. We achieve this by using the same construction that we use for cut elimination. In summary, by expanding the language of propositional logic, we make its proof theory more regular and generate more proofs, some of which are very efficient. That design is made possible by considering propositional variables as superpositions of their truth values, which are connected by self dual, non commutative connectives. A proof can then be projected via each propositional variable into two proofs, one for each truth value, without a need for cuts. Those projections are semantically natural and are at the heart of all the constructions in this paper. To accommodate self dual non commutativity, we compose proofs by deep inference.


Translational Concept Embedding for Generalized Compositional Zero shot Learning. Generalized compositional zero shot learning means to learn composed concepts of attribute object pairs in a zero shot fashion, where a model is trained on a set of seen concepts and tested on a combined set of seen and unseen concepts. This task is very challenging because of not only the gap between seen and unseen concepts but also the contextual dependency between attributes and objects. This paper introduces a new approach, termed translational concept embedding, to solve these two difficulties in a unified framework. It models the effect of applying an attribute to an object as adding a translational attribute feature to an object prototype. We explicitly take into account of the contextual dependency between attributes and objects by generating translational attribute features conditionally dependent on the object prototypes. Furthermore, we design a ratio variance constraint loss to promote the model's generalization ability on unseen concepts. It regularizes the distances between concepts by utilizing knowledge from their pretrained word embeddings. We evaluate the performance of our model under both the unbiased and biased concept classification tasks, and show that our model is able to achieve good balance in predicting unseen and seen concepts.


Bootstrapping Relation Extractors using Syntactic Search by Examples. The advent of neural networks in NLP brought with it substantial improvements in supervised relation extraction. However, obtaining a sufficient quantity of training data remains a key challenge. In this work we propose a process for bootstrapping training datasets which can be performed quickly by non NLP experts. We take advantage of search engines over syntactic graphs (Such as Shlain et al. (2020)) which expose a friendly by example syntax. We use these to obtain positive examples by searching for sentences that are syntactically similar to user input examples. We apply this technique to relations from TACRED and DocRED and show that the resulting models are competitive with models trained on manually annotated data and on data obtained from distant supervision. The models also outperform models trained using NLG data augmentation techniques. Extending the search based approach with the NLG method further improves the results.


Photoexcitation of atoms by cylindrically polarized Laguerre Gaussian beams. We analyze the photo excitation of atoms with a single valence electron by cylindrically polarized Laguerre Gaussian beams. Theoretical analysis is performed within the framework of first order perturbation theory and by expanding the vector potential of the Laguerre Gaussian beam in terms of its multipole components. For cylindrically polarized Laguerre Gaussian beams, we show that the (magnetic) sub components of electric quadrupole field vary significantly in the beam cross section with beam waist and radial distance from the beam axis. We discuss the influence of varying magnetic multipole component in the beam cross section on the sub level population of a localized atomic target. In addition, we calculate the total excitation rate of electric quadrupole transition ( 4s 2 S 1 2 rightarrow 3d 2 D 5 2 ) in a mesoscopic target of Ca ion. These calculations shows that the total rate of excitation is sensitive to the beam waist and the distance between center of the target and the beam axis. However, the excitation by cylindrically polarized Laguerre Gaussian beam is found more efficient in driving electric quadrupole transition in the mesoscopic atomic target than the circularly polarized beams.


Performance Evaluation of Pulse Shape Discrimination Capable Organic Scintillators for Space Applications. Scintillators with pulse shape discrimination (PSD) capability are of great interest to many fields in the scientific community. The ability to discern a gamma ray from a neutron using PSD varies between different types of scintillator materials and dopants. A new generation of organic scintillator materials with PSD capability were studied to determine their radiation hardness to ionizing and non ionizing radiation. The PSD capability, average pulse shapes, and light output of four types of organic scintillator were characterized before and after neutron and gamma ray irradiation. The main goal of this investigation is to study the effects of long term irradiation that may be experienced in space applications on the light output and particle discriminating capabilities of each material. EJ 270, EJ 276, organic glass, and Stilbene were tested. Damage due to non ionizing (neutron) radiation was not observed in any of the scintillators up to 2.56 times10 11 n cm 2 , except for Stilbene which showed a small (12 ) decrease in light output. All scintillators presented some light output reduction after ionizing (gamma ray) irradiation, with reductions of 17 (EJ 276 and OGS), 32 (EJ 270), and 42 (Stilbene) observed immediately after 100 kRad.


On pseudofunctors sending groups to 2 groups. For a category B with finite products, we first characterize pseudofunctors from B to Cat whose corresponding opfibration is cartesian monoidal. Among those, we then characterize the ones which extend to pseudofunctors from internal groups to 2 groups. If B is additive, this is the case precisely when the corresponding opfibration has groupoidal fibres.


Flexibility and analytic smoothing in averaging theory. Using a new strategy, we extend the classical Nekhoroshev's estimates to the case of H "older regular steep near integrable hamiltonian systems, the stability times being polynomially long in the inverse of the size of the perturbation. We prove that the stability exponents can be taken to be ( ell 1) (2n alpha 1... alpha n 2 ) for the time of stability and 1 (2n alpha 1... alpha n 1 ) for the radius of stability, ell n 1 being the regularity and the alpha i 's being the indices of steepness. Our strategy consists in deriving a perturbation theory which exploits a sharp analytic smoothing theorem to approximate any H "older function by an analytic one. In addition, an appropriate choice of the free parameters in the problem enables us to have a first grasp on the relation connecting the time and radius of stability to the threshold that the size of the perturbation must satisfy in order for the theorem to apply. Particular attention is payed to a geometric presentation of the construction of the so called "resonant blocks", in order to shed a definitive light on the nature of the steepness condition. We also investigate the convex setting, using a similar approach.


Essential dimension of semisimple groups of type B . We determine the essential dimension of an arbitrary semisimple group of type B of the form G big( operatorname mathbf Spin (2n 1 1) times cdots times operatorname mathbf Spin (2n m 1) big) boldsymbol mu over a field of characteristic 0 , for all n 1 , ldots, n m geq 7 , and a central subgroup boldsymbol mu of operatorname mathbf Spin (2n 1 1) times cdots times operatorname mathbf Spin (2n m 1) not containing the center of operatorname mathbf Spin (2n i 1) as a direct factor. We also find the essential dimension of G for each of the following cases, where either n i 1 for all i or m 2 , n 1 1 , 2 leq n 2 leq 3 , boldsymbol mu is the diagonal central subgroup for both cases.


Deploying Near Optimal Delay Constrained Paths with Segment Routing in Massive Scale Networks. With a growing demand for quasi instantaneous communication services such as real time video streaming, cloud gaming, and industry 4.0 applications, multi constraint Traffic Engineering (TE) becomes increasingly important. While legacy TE management planes have proven laborious to deploy, Segment Routing (SR) drastically eases the deployment of TE paths and is thus increasingly adopted by Internet Service Providers (ISP). There is a clear need in computing and deploying Delay Constrained Least Cost paths (DCLC) with SR for real time interactive services. However, most current DCLC solutions are not tailored for SR. They also often lack efficiency or guarantees. Similarly to approximation schemes, we argue that the challenge is to design an algorithm providing both performances and guarantees. However, conversely to most of these schemes, we also consider operational constraints to provide a practical, high performance implementation. We leverage the inherent limitations of delay measurements and account for the operational constraint added by SR to design a new algorithm, best2cop, providing guarantees and performance in all cases. Best2cop outperforms a state of the art algorithm on both random and real networks of up to 1000 nodes. Relying on commodity hardware with a single thread, our algorithm retrieves all non superfluous 3 dimensional routes in only 250ms and 100ms respectively. This execution time is further reduced using multiple threads, as the design of best2cop enables a speedup almost linear in the number of cores. Finally, we extend best2cop to deal with massive scale ISP by leveraging the multi area partitioning of these deployments. Thanks to our new topology generator specifically designed to model the realistic patterns of such massive IP networks, we show that best2cop solves DCLC SR in approximately 1 second even for ISP having more than 100000 routers.


Optimal fine scale structures in compliance minimization for a uniaxial load in three space dimensions. We consider the shape and topology optimization problem to design a structure that minimizes a weighted sum of material consumption and (linearly) elastic compliance under a fixed given boundary load. As is well known, this problem is in general not well posed since its solution typically requires the use of infinitesimally fine microstructure. Therefore we examine the effect of singularly perturbing the problem by adding the structure perimeter to the cost. For a uniaxial and a shear load in two space dimensions, corresponding energy scaling laws were already derived in the literature. This work now derives the scaling law for the case of a uniaxial load in three space dimensions, which can be considered the simplest three dimensional setting. In essence, it is expected (and confirmed in this article) that for a uniaxial load the compliance behaves almost like the dissipation in a scalar flux problem so that lower bounds from pattern analysis in superconductors can directly be applied. The upper bounds though require nontrivial modifications of the constructions known from superconductors. Those become necessary since in elasticity one has the additional constraint of angular momentum conservation.


Improving the Behaviour of Vision Transformers with Token consistent Stochastic Layers. We introduce token consistent stochastic layers in vision transformers, without causing any severe drop in performance. The added stochasticity improves network calibration, robustness and strengthens privacy. We use linear layers with token consistent stochastic parameters inside the multilayer perceptron blocks, without altering the architecture of the transformer. The stochastic parameters are sampled from the uniform distribution, both during training and inference. The applied linear operations preserve the topological structure, formed by the set of tokens passing through the shared multilayer perceptron. This operation encourages the learning of the recognition task to rely on the topological structures of the tokens, instead of their values, which in turn offers the desired robustness and privacy of the visual features. The effectiveness of the token consistent stochasticity is demonstrated on three different applications, namely, network calibration, adversarial robustness, and feature privacy, by boosting the performance of the respective established baselines.


The cross product conjecture for width two posets. The cross product conjecture (CPC) of Brightwell, Felsner and Trotter (1995) is a two parameter quadratic inequality for the number of linear extensions of a poset P (X, prec) with given value differences on three distinct elements in X . We give two different proofs of this inequality for posets of width two. The first proof is algebraic and generalizes CPC to a four parameter family. The second proof is combinatorial and extends CPC to a q analogue. Further applications include relationships between CPC and other poset inequalities, including a new q analogue of the Kahn Saks inequality.


Euclidean 3D Stable Roommates is NP hard. We establish NP completeness for the Euclidean 3D Stable Roommates problem, which asks whether a given set V of 3n points from the Euclidean space can be partitioned into n disjoint (unordered) triples Pi V 1, dots,V n such that Pi is stable. Here, stability means that no three points x,y,z in V are blocking Pi , and x,y,z in V are said to be blocking Pi if the following is satisfied delta(x,y) delta(x,z) delta(x,x 1) delta(x,x 2) , delta(y,x) delta(y,z) delta(y,y 1) delta(y, y 2) , and delta(z,x) delta(z,y) delta(z,z 1) delta(z,z 2) , where x,x 1,x 2 , y,y 1,y 2 , z,z 1,z 2 in Pi , and delta(a,b) denotes the Euclidean distance between a and b .


Asymptotic Behavior and Typicality Properties of Runlength Limited Sequences. This paper studies properties of binary runlength limited sequences with additional constraints on their Hamming weight and or their number of runs of identical symbols. An algebraic and a probabilistic (entropic) characterization of the exponential growth rate of the number of such sequences, i.e., their information capacity, are obtained by using the methods of multivariate analytic combinatorics, and properties of the capacity as a function of its parameters are stated. The second order term in the asymptotic expansion of the rate of these sequences is also given, and the typical values of the relevant quantities are derived. Several applications of the results are illustrated, including bounds on codes for weight preserving and run preserving channels (e.g., the run preserving insertion deletion channel), a sphere packing bound for channels with sparse error patterns, and the asymptotics of constant weight sub block constrained sequences. In addition, the asymptotics of a closely related notion q ary sequences with fixed Manhattan weight is briefly discussed, and an application in coding for molecular timing channels is illustrated.


Composing Behaviors of Networks. This thesis aims to develop a compositional theory for the operational semantics of networks. The networks considered are described by either internal or enriched graphs. In the internal case we focus on mathsf Q nets, a generalization of Petri nets based on a Lawvere theory mathsf Q . mathsf Q nets include many known variants of Petri nets including pre nets, integer nets, elementary net systems, and bounded nets. In the enriched case we focus on graphs enriched in a quantale R regarded as matrices with entries in R . These R matrices represent distance networks, Markov processes, capacity networks, non deterministic finite automata, simple graphs, and more. The operational semantics of mathsf Q nets is constructed as an adjunction between mathsf Q nets and categories internal to the category of models of mathsf Q . Similarly, the operational semantics of R matrices is constructed as an adjunction between R matrices and categories enriched in R . The left adjoint of this adjunction sends an R matrix M to the R category F R(M) whose hom objects are solutions of the algebraic path problem a generalization of the shortest path problem to graphs weighted in R . For both mathsf Q nets and R matrices we use the theory of structured cospans to study the compositionality of the above operational semantics. For each type of network we construct a double category whose morphisms are "open networks", i.e. networks with certain vertices designated as input or output. We introduce the black boxing of an open network, a profunctor describing the externally observable behavior of an open network. We introduce a class of open networks called "functional open networks" for which black boxing preserves composition.


Microlocal Methods for The Elastic Travel Time Tomography Problem for Transversely Isotropic Media. We study the travel time tomography problem for transversely isotropic media using the artificial boundary method used in works in X ray tomography and boundary rigidity problems. The analysis involved requires a modification of the scattering pseudodifferential calculus in order to provide parametrices for operators which are degenerately elliptic such a calculus is constructed in this paper and used to solve the tomography problem of interest.


FewCLUE A Chinese Few shot Learning Evaluation Benchmark. Pretrained Language Models (PLMs) have achieved tremendous success in natural language understanding tasks. While different learning schemes fine tuning, zero shot, and few shot learning have been widely explored and compared for languages such as English, there is comparatively little work in Chinese to fairly and comprehensively evaluate and compare these methods and thus hinders cumulative progress. In this paper, we introduce the Chinese Few shot Learning Evaluation Benchmark (FewCLUE), the first comprehensive few shot evaluation benchmark in Chinese. It includes nine tasks, ranging from single sentence and sentence pair classification tasks to machine reading comprehension tasks. We systematically evaluate five state of the art (SOTA) few shot learning methods (including PET, ADAPET, LM BFF, P tuning and EFL), and compare their performance with fine tuning and zero shot learning schemes on the newly constructed FewCLUE benchmark. Experimental results reveal that 1) The effect of different few shot learning methods is sensitive to the pre trained model to which the methods are applied 2) PET and P tuning achieve the best overall performance with RoBERTa and ERNIE respectively. Our benchmark is used in the few shot learning contest of NLPCC 2021. In addition, we provide a user friendly toolkit, as well as an online leaderboard to help facilitate further progress on Chinese few shot learning. We provide a baseline performance on different learning methods, a reference for future research.


Exact Limit Theorems for Restricted Integer Partitions. For a set of positive integers A , let p A(n) denote the number of ways to write n as a sum of integers from A , and let p(n) denote the usual partition function. In the early 40s, Erd H o s extended the classical Hardy Ramanujan formula for p(n) by showing that A has density alpha if and only if log p A(n) sim log p( alpha n) . Nathanson asked if Erd H o s's theorem holds also with respect to A 's lower density, namely, whether A has lower density alpha if and only if log p A(n) log p( alpha n) has lower limit 1 . We answer this question negatively by constructing, for every alpha 0 , a set of integers A of lower density alpha , satisfying liminf n rightarrow infty frac log p A(n) log p( alpha n) geq left( frac sqrt 6 pi o alpha (1) right) log(1 alpha) . We further show that the above bound is best possible (up to the o alpha(1) term), thus determining the exact extremal relation between the lower density of a set of integers and the lower limit of its partition function. We also prove an analogous theorem with respect to the upper density of a set of integers, answering another question of Nathanson.


Predicting Lexical Complexity in English Texts. The first step in most text simplification is to predict which words are considered complex for a given target population before carrying out lexical substitution. This task is commonly referred to as Complex Word Identification (CWI) and it is often modelled as a supervised classification problem. For training such systems, annotated datasets in which words and sometimes multi word expressions are labelled regarding complexity are required. In this paper we analyze previous work carried out in this task and investigate the properties of complex word identification datasets for English.